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(54) Information processing apparatus, method for the same, and storage medium 



(57) An apparatus for processing information is pro- 
vided which is capable of providing a digital camera hav- 
ing a communication function intended to improve the 
performance while retaining compactness and immedi- 
acy. 

According to one preferred embodiment of the 
present invention, such an apparatus is disclosed that 
to a size of data (first data) expected to be received is 
added an expected size of second data to be entered 
(for example, an expected size of image data obtained 
in a predetermined photography image-quality mode), 
so that a resultant sum is compared to an amount of a 
remaining storage capacity of a memory (storage medi- 
um), and if that sum is larger than that remaining storage 
capacity, the apparatus sends a direction to an effect 
that the data expected to be received should be sent 
(transferred) to a predetermined transmission destina- 
tion. With this, in such a case, the first data is not re- 
ceived, so that the first data is sent to the predetermined 
transmission destination. 



FIG. 1 
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Description \ yv o • v. r.: *v - \ - 

BACKGROUND OF THE INVENTION ... . . > ■ . 5i , , . • 

Field of the Invention 

[0001] The present invention relates to an information processing method, an apparatus for the same, and a storage 
medium which stores process steps in such a way that the computer can read these steps that can be applied to digital 
cameras etc. provided with a communication function. ■* 

Related Background Art 



[0002] Recent years have seen dramatic pervasion of digital cameras promoted by the improvements in the tech- 
nologies of semiconductors etc. The digital camera digitizes photographed images and stores the results into an image 
is memory, which comes particularly in a semiconductor memory in many cases. 

i [0003] Semiconductor memories, however, are very expensive, so that, taking into consideration the overall costs 
of the digital camera, the capacity of its semiconductor memory is limited. That is, the number of photographs that can 
be taken is also limited. Presently, the capacity of a semiconductor memory equipped to digital cameras on a standard 
basis is not sufficient with respect to a photographing frequency generally required for camera equipment. 
[0004] To guard against this, for example, such a digital camera is marketed that as an image memory is used a 
replaceable storage device such as a PCMCIA flash memory card or a smart memory to permit the user to replace it 
as required, thus increasing the number of photographs that can be taken. 

[0005] The availability of flash memory cards or smart memories, however, is very low as compared to silver salt 
films, so that it is not always possible for the user to have such an image memory at hand when necessary. The user, 
therefore, must expect beforehand the number of photographs to be taken and add a sufficient margin to that number 
for PCMCIA flash memory cards or smart media^to be carried. This situation cannot be said to utilize efficiently the 
:• feature of using replaceable storage devices as the image memory. , i " 

[0006] On theiother hand, as the image. memory may be used a magnetic memory such as a hard disc instead of 
semiconductor memories, to ass urea sufficient number of photographs that can be taken with respect to a photograph- 
30 ing frequency generally required for.digital cameras. . 

[0007] However, even with a magnetic memory employed as the image memory, its memory capacity is not infinite. 
That is, it is limited. Moreover, a magnetic memory requires larger power dissipation and also larger dimensions of its 
equipment body. Magnetic memories, therefore, are not appropriate as the image memory of camera equipment, which 
needs to be portable. 

35 [0008] As mentioned above, the conventional digital cameras have been limited in terms of the number of photo- 
graphs that can be taken due to the. limited capacity of the built-in image memory and .the poor availability of the 
replaceable storage device. With this, when one want to take photographs in excess of a limited number,, he must, for 
example at a photographing site, erase unnecessary photographs of those already stored in the image memory or 
transfer already photographed images to a storage device in the personal computer to increase the usable capacity 

40 of the image memory; .-;.:.! \, 

[0009] The above-mentioned work, if carried out at a photographing site however, gives a time-wise loss, bringing 
about a large defect to digital cameras, which is required to be of immediacy. 

[0010] Specifically, to erase unnecessary images of already photographed ones, various types of information must 
be confirmed to decide which images are unnecessary. The confirmation work makes up a heavy load on the photog- 
45 rapher if it is carried out with a digital camera, which has a relatively low processing speed as compared to a personal 
computer. Especially, the quality of photographed images are rather difficult to judge with a small-sized display generally 
equipped to the digital camera. " 

[001 1] Furthermore, the above-mentioned confirmation work requires for its effective performing to mount new groups 
of dedicated-use operation switches and information-confirmation displays. This situation prevents the miniaturization 
50 of digital cameras. 

[0012] Moreover, it is a psychological burden for the photographer to erase his photographed images at site, thus 
bringing about a strong resistance to him psychologically. 

[001 3] When photographed images are transferred to a storage device in the personal computer, on the other hand, 
the above-mentioned psychological burden is not given, but the photographer has to carry with him an interface etc. 
55 - between the digital camera and the personal computer, thus having that much physical burdens. 

[0014] To solve the above-mentioned problems, such a suggestion may be made that the digital camera be, for 
example, provided with a communication function to send and receive photographed images and E-mails as required 
[0015] However, even in such a configuration that a digital camera is provided with a communication function, if the 
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photographed images and the received data are stored in the same memory, collision occurs to that memory, thus 
disabling photographing or data reception. 

[0016] If, for example, a communication call occurs immediately before one'phdtographs something and the reception 
data occupies the memory into which the photographed image is to be stored, the previously possible photographing 
5 is no longer possible. 

[0017] To avoid such a problem, the user needs to decide whether communication is permitted or not each time he 
receives a call, which however loses the immediacy for photographing as well as~ shutter chances. Such a proolem 
provides a large defect for digital cameras. 

[001 8] In addition, if a photographing function is worked during communication, the received data may not be stored 
io in the memory to the last moment.. This also affects the certainty of communication, providing a large defect for the 
communication function. •' ^ ■ ■ 

[0019] As a countermeasure against the above-mentioned problems has already been disclosed by the same ap- 
plicant as the present invention a technology that a sum, A, of- an amount-of reception-expected data and a typical 
data size of images obtained in the current^photographing mode is compared to the remaining amount of memory 
is capacity and, if A is larger than the remaining amount;1he compressibility of the image. data is increased (U.S. appli- 
cation No. 09/162,720 tiled on September 30, 1998). This technology, however, may degrade the quality of photo- 
graphed images and make it impossible -to photograph a sufficient number of images. Jf, also,^ received data alone 
exceeds the remaining amount of storage capacity, thatlechnolbgy needs improvements. »* . - 
[0020] Another disclosure-teaches to store only part of received data in a memory; however, if such data as required 
20 as a whole is received, -this method also needs improvements. s : ■ ■ 

SUMMARY OF THE INVENTION : - x . - -i 

[0021] » A concern of the present invention is to solve all or at least one of the above-mentioned problems. 

2S . [0022] Another concern of the present invention" is to prevent.the rapparat us functions from* being limited with the 
decreasing remaining (unrecorded) amount of the storage: capacity--' , -jn^? o t*:vr> v ic r' 
[0023] Still another concern of the present invention is not to damage the irnraediacyofUhe data generation function. 
[0024] -Stilhanother concern of the present invention is to prevent generated data from'hot being ^recorded with the 
decreasing remaining amount of the storage capacity because of received dataj ' i ~ ^ . < 

30 [0025] One aspect of the present invention provides a method which comprises the stepsof: \ j 

receiving data; *■ . - • r • :v 4-:- > ■ * * 1 "■ ■ 

generating data; .■: .r- -v <■ ^ -.^ . ..jok -am c^i < ; .;*•.. \- . - 

and controlling the recording of first data received at the above-mentioned reception step and' second data gen- 
35 erated at the above-mentionedigeneration step, imo a storage, medium;-, sr- ; : : - ■■■oil.-*:-.. ?• 

wherein, the above-mentioned*controlling step controls' the recording of the 'above-mentioned first data into the 
above-mentioned storage medium so ttiat the. above-mentioned' second datamaybe stored in a remaining (unre- 
corded) region=of the above-mentioned storage mediumi when the above^mentiqned.firsy data is received. 

40 [0026] Still another concern of the present invention is to receive surely the data which has been sent without un- 
reasonably decreasing theamountof the received data or the data to be generated, 'even.if the existing storage capacity 
is not enough to store all of the received data. . 1 :-j ' r-:-. « . <: >r.- < ^ : - 

[0027] Another aspect of: the present' invent ion;prov ides a method for information processing! wherein the above- 
mentioned controlling step comprises a sending step of sending to the sending apparatusan .direct ion (instruction) that 

45 the above-mentioned first data should be.transf erred to another apparatus ifithe difference between the remaining 
amount of storage capacityxtf the above-mentioned storagamedium and. the amount of the^abbve-mentioned first data 
is less than a predetermined value. v- -\ " *• ; 

[0028] Also, another information processing method.is disclosed, wherein the above-mentioned controlling step com- 
prises a sending step of sending data corresponding at least to4he amount of the above-mentioned-first data of the 

so data stored in the storage medium if the difference between the remaining amount of the storage capacity of the above- 
mentioned storage medium and 1 . the. amount of the above-mentioned first data is less than a predetermined vatue. 
[0029] Still another concern of the present invention is to improve -the function of the imaging (imageipickup) step 
which needs immediacy, ir; ■■. ,.*s > ■ '->•■ • ■ ■•« - - . ••' ' > * » 

[0030] A third aspect of the present invention provides an- information processing method, wherein the above-men- 

ss tioned generation step.comprises an imaging step, thereby .generating image data imaged (picked up) by the above- 
mentioned imaging step as the above-mentioned second data. 1. : tf 
[0031] Still another concern of the present invention is to provide a user-desired image quality of the images obtained 
by the imaging step. ? * 



3 



BNSDOCID: <EP 0991260A2_I_> 



10 



> CEP 0 991 260 A2 

[0032] A fourth aspect of the present invention provides ah information processing method; wherein the above- 
mentioned imaging step has a plurality of modes each relating to the data size of photographed images, and the above- 
mentioned predetermined value is determined to be larger than at least the data amount of an image according to the 
above-mentioned modes. 

[0033] Still another concern of the present invention is to provide such a storage medium that stores the-programs 
for realizing by use of computers an information processing apparatus provided with functions to realize the above- 
mentioned methods, an imaging apparatus,, a communication apparatus, or the above-mentioned methods. 
[0034] Also, other advantages and features of the present invention will be apparent from the following description 
of the embodiments with reference to the appended drawings. 

BRIEF DESCRIPTION OF THE> DRAWINGS 

[0035] 

'5 FIG. 1 is an external view of a digital camera according to a first embodiment; - 

FIG. 2 is another external view of the above-mentioned digital camera as viewed in another direction; 
FIG. 3 illustrates the mode dials of the above-mentioned digital camera; 
FIG. 4 shows various functions of the. above-mentioned digital camera; . . 

FIG. 5 is comprised of FIGS. 5A and 5B showing a block diagram of an internal configuration of the above-men- 
20 tioned digital camera; .; ■ . ; 

FIG. 6 is a block diagram of a detailed configuration of a camera unit of the above-mentioned digital camera; 
FIG. 7 is a flowchart illustrating programs for performing photographing by the above-mentioned digital camera; 
FIG. 8 is comprised of FIGS. 8A and 8B showing a flowchart illustrating programs for performing interrupt process- 
ing by key operations in the above-mentioned photographing; *.-■ 

FIG. 9 is a flowchart Illustrating programs for performing a pJay-back.function in the above-mentioned interrupt 
processing; 

• FIG. 10 is a flowchart illustrating programs for performing an image reproduction (display) operation for the above- 
mentioned digital camera; 

FIG. 11 is a flowchart illustrating programs for performing E-mail link establishing processing for the above-men- 
30 tioned digital camera; 

FIG. 12 is a flowchart illustrating programs for performing sending operation for the above-mentioned E-mails; 
FIG. 1 3 is a flowchart illustrating programs for performing receiving processing for the above-mentioned E-mails: 
• J- Fig. 14 is a block diagram showing a conceptual control flow of the above-mentioned digital camera; 

' FIG. 1 5 is a flowchart illustrating programs for performing operation control for the above-mentioned digital camera; 
35 FIG. 16 is a flowchart illustrating programs for performing operation control for the above-mentioned digital camera 

in a second embodiment; " • • 

FIG. 1 7 is a flowchart illustrating programs for performing operation control for the above-mentioned digital camera 
; in a third embodiment; *• . 

FIG. 18 is a flowchart illustrating programs for performing operation control for the above-mentioned digital camera 
40 in a fourth embodiment; . • ... v .. . • • ■: - , . 

FIG; 1 9 is a block diagram of a fifth embodiment showing a conceptual control flow of the above-mentioned digital 
camera; ' ~ ■ . \ • v *.: ... ... ■* ■ 

FIG. 20 is a flowchart illustrating programs for performing operation control for the above-mentioned digital camera; 
FIG. 21 is a flowchart illustrating one example of transmission-image selection processing in the above-mentioned 
45 operaiion control; . ^ 

FIG. 22 is a flowchart illustrating another example of the above-mentioned transmission-image selection process- 
ing; I ' ■ . - ■ ; ' - •< , •• ■ .;. 
FIG: 23 is a flowchart illustrating programs for performing operation control for the above-mentioned digital camera 
in a sixth embodiment; . •.>■..£. , ■ » 
so FIG, 24 is a flowchart illustrating programs for performing operation control for the above-mentioned digital camera 
in a seventh embodiment; and . , . - * 

FIG. 25 is a flowchart illustrating programs for performing operation control for the above-mentioned digital camera 

in an eighth embodiment. \ .. • . • 

>....."« • .- i 

ss » • : • . . .y •, • > 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS ■ ; -r» . 

(First embodiment) - . ♦ ■ - • . . .-n t. « .*i - * . ** 

5 [0036] An image processing method related to the present- invention is carried out by a digital. cam era 100'such as 
shown for example in FIG. 1. i ■ . Y 

[0037] The digital camera 100 applies an image processing apparatus or an image entry apparatus related to the 
present invention. ... 

[0038] That is, the digital camera 100 in this embodiment has such communication functions as a telephone or an 
10 E-mail, being provided, as shown in FIG. 1 (external view of the apparatus), with a shutter button 102, a mode dial 
101 ,a lens 103, and a strobe 109 arranged above the lens 108 on the front surface of the body. 
[0039] On the side of the body of the digital camera 1 00 are provided a built-in speaker 1 05, a black/white LCD 1 04, 
a keyboard 103, a later-mentioned jog dial (not shown), and a built-in microphone 106. 

[0040] Also, a pointing device 110 is provided, as shown in FIG. 2 (external view of the apparatus as viewed from 
15 an arrow A direction in FIG. 1 above), on a surface opposing the surface on which are provided the shutter button 102, 
the mode dial 101, the lens 108, and the strobe 109. j ■.« 

[0041] Further, the above-mentioned speaker 1 05 is, as shown in the figure, provided to the body of the digital camera 
100 in such a way that it can be opened and>closed in the arrow B direction and that when it is opened, the LCD 107 
can be observed. ... l • . 

20 [0042] Note here that the above-mentioned mode dial 101 has a power-switch function, so that as shown in FIG. 3 
(front view of the mode dial 101 as shown from an, arrow C direction in FIG.1 above),; it may turn about the shutter 
button 102. ■ - . * * ■ - - 

[0043] With this mode dial 101 being turned, the mode can be switched. among. the power-off state (OFF mode), the 
telephone-enabled state (TEL mode), the state that displays the information such as images, voice, texts, etc. stored 
25 . in the digital-camera 100 (VIEW mode), and the state where the camera can.be used for photographing (CAMERA 
mode). 

. [0044] With this, the functions in the above-mentioned various modes, of the.- digital camera 10.0; can be shown in 

FIG. 4. ■• : : r- 4 - 

[0045] As shown in FIG. 4, all the modes except the OFF mode are capable:of receiving telephone .calls (TEL call 
30 receiving function). 1 j 

[0046] .In the TEL mode, one can operate< usual personal handy-phone system (PHS) telephones (TEL call receiving 
function and TEL call transmission function). That is, in the TEL mode, one can enter telephone numbers" from the 
keyboard 103 of the digital camera-100 body and display the. numbers entered inrthe black/white LCD 104 and the 
telephone numbers stored beforehand*(display of the telephone book), so that he can use : the. telephone for transmis- 
35 sion and reception of calls by using the built-in speaker 105 and microphone 106. ? . •; - . . s - 

[0047] In the TEL mode also, as occasion demands, one can use a color LCD 107,-.to use various oolors in order to 
select complex optional functions easily. . ;* ... ' r 

[0048] Note here that the "transmission and reception of telephone calls" as referred to here intends to include data 
. communication enabled by PHS telephones, cellular telephones, etc. - . . ^ ... . : i . 

40 [0049] In the VIEW mode, one can select the images photographed in the later-described CAMERA mode, the re- 
corded voice,, the received images or voice,* or the texts, to reproduce or display them (image display/output function, 
audio output function, text display function, E-mail function). 

[0050] . In the CAMERA node, the detailed of which are described later, the image.of a subject with an intervention 
■ of the lens 1 08 is photo-electrically transferred by a charge coupled device (CCD) or other imaging element into electric 
45 signals, which then undergo predetermined image processing and are stored in a flash memory or other memory device 
. (image entry/storage functions). 

[0051] In the CAMERA mode also, the pointing device is used to select the light-emitting conditions of the strobe 
109 .from the menu screen displayed- on. the color. LCD 107 and, under such conditions, illuminate the subject. 
[0052] Further, in the CAMERA mode, the later-described play-back function enables one tocheck photographed 
50 images, erase them if they are unnecessary, record them as annotation (audio; entry/storage function), or send them 
as E-mails to desired destinations (E-mail transmission function). 

[0053] .The above-mentioned digital camera 100 has such an internal configuration that,,as shown in FIG.5 for ex- 
ample, mainly has a main-CPU unit 201 , a sub-CPU unit 202, a PHS unit 203, and a camera.unit 204, -which cooperate 
in performing various functions in the above-mentioned TEL mode, the VIEW mode, and the CAMERA mode. 
55 [0054] The following will describe the operations of the main-CPU unit 201 , the sub-CPU unit 202, and the camera 
unit 204 specifically. 
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Camera unit 204 ■ ■.. v ^,.•.•1:^. r ( .: . ■ .. 

[0055] FIG. 6 specifically shows the camera unit 204 of FIG. 5 above. 
- [0056] As shown in FIG: 6, the camera unit 204 comprises: an imaging, element 213 so provided that an incident 
$ light from the lens of FIG.1 above may form an image on the. imaging surface; a CDS/AGC circuit 214 to which an 
output from the imaging element 213. is supplied; an A/D converter 215 to which an output from the CDS/AGC circuit 
214 is supplied; a signal processing circuit 216 J to .which aa output from the A/D converter is supplied; and a camera 
microcomputer 211 connected with a CPU 29 (FIG: 5) of the main-CPU 210, the details of which are described later, 
so that an output from the camera microcomputer 211 is supplied to the signal processing circuit 216 and an output 

io from the signal processing circuit 216 is supplied to the CPU 29. 

[0057] The camera unit 204 comprises a timing generator 218 to which an output from the CPU 29 is supplied and 
a vertical driver 21 7 to which an output from the timing generator 218 is supplied, so that an output from the timing 
generator is supplied to the imaging element 213, the CDS/AGC circuit 214, the A/D converter 215, and the signal 
processing circuit 216, and an output from the vertical driver is supplied to the imaging element 213. 

is [0058] Also, to the above-mentioned signal processing circuit 216 is supplied an output from the CPU 29. 

[0059] In the camera unit 204 such as mentioned above, the camera microcomputer 211 communicates with the 
CPU 29 which controls the entire apparatus., thus conducting control over the entire camera unit 204. For example, 
the camera microcomputer 211 is provided with information on the position of the lens 108 (see FIG. 1 above), thereby 
controlling the operations for various kinds of image processing and sends to the GPU 29 the information to promote 

20 the user to perform operations. based on the conditions of the diaphragm. 

[0060] Specifically, the lens 108 is for example a zoom lens with a magnification of x3 and so configured as to be 
capable of moving the zoom position manually, having a focal distance of 34-103 mm in terms of 35-mm camera. The 
lens position is output by a Hall element (not shown) to the camera microcomputer 211. The camera microcomputer 
211 , therefore, controls the operations of the camera unit 204 so that various kinds of image processing may be per- 

25 formed according to thus obtained lens position of the lens 108. 

[0061] The brightness, on the other hand; comes in for example F2:4 through F3:5. Between the lens 108andthe 
imaging element 214 are provided two types of optical diaphragms (not shown) for opening and closing the aperture, 
which are operated by hand. With this, the camera microcomputer 211 detects the aperture-closing positionand sends 
the results to the GPU 29. ^ The CPU 29, therefore, notifies the user of such warning as shortage or excess of the light 

30 amount based on these detected results. 

■ [0062] The strobe 109 is provided with a dimmer circuit.and controlled in terms of charging and light emission also 
by the camera microcomputer 211. That is, the strobe 109 changes the dimming control reference level based on the 
lens position of the lens 108 (zoom lens) supplied f rom the camera microcomputer 211 , thus obtaining appropriate light 
emission irrespective of the lens position of the lens 108. - . 

35 [0063] Note here that the CPU 29, the details of which are described later, comprises hybrid IC's having a memory 
controller and a serial interface, to control the apparatus as a whole. 

[0064] The above-mentioned control by the camera microcomputer 211 permits the camera unit 204 to behave as 
follows., : . :■ ■>.--. ; <; ■. ^ • . 0 • { ... 

[0065] • First a timing generator (TG) 218 is provided . w it h a clock K signal 230 which provides a basis for the timing 
40 of the apparatus as. a whole. and a horizontal/vertical synchronization signal 40 generated by the CPU 29 at display 
timing at the imaging element 108/ . -1 < 

[0066] The timing generator, which generates timing signals to the imaging element 21 3 so that it may form images, 
synchronizes with the clock K signal 230 and the horizontal/vertical synchronization signal 40 to supply a timing signal 
226 (timing signal which provides a basis for forming images) to the imaging element 213, a timing signal 227 (timing 
45 signal given to the imaging element 213 for voltage conversion), a sample-hold signal 231 (timing signal for holding 
sampling) to the CDS/AGC circuit 214, and a sample-clock signal 228 (clock signal which provides a basis for sampling 
picture element signals) to the A/D converter 215 and the signal processing circuit 216. 

[0067] At the same time, the lens 108 refracts a light from a subject (not shown) to collect it onto the imaging surface 
(charged surface) of the imaging element 213. 
50 [0068] The imaging element 213 comprises for example CCD's and forms images having dimensions of for example 
horizontal 1280 picture elements (dots) x vertical 960 picture elements. The imaging element 21 3 converts the above- 
mentioned subject light from the lens 108 into an electric signal (charge) according to the timing signal from the timing 
generator 218 and supplies it as an analog signal to the CDS/AGC circuit 214. 

[0069] The vertical driver (V-river) 217 converts the voltage amplitude of signals which drive the imaging element 
55 213 according to the timing signal 227 from the timing generator 218. 

[0070] With this, the-CDS/AGC circuit 214 is provided with an electric signal comprising horizontal 1280 dots and 

vertical 960 dots as a photographed-image signal. < 

[0071] The CDS/AGC circuit 21 4- samples the photographed-image signal 222 given from the imaging element 108 
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according to the sample-hold signal 231 from the timing generator 218, to automatically control its signalamplitude. 
The CDS/AGC circuit 214 then supplies the photographed-image signal given as a result of the processing to the A/ 
D converter 215. • - -- - 

[0072] The A/D converter 215, according to the sample-lock signal 228 from the timing generator 218, converts a 
s photographed-image signal (analog picture-element signal) from the CDS/AGC circuit 21 5 into -10-bit digital data 64 
and supplies the digital data 224 to the signal processing circuit 216 through a 1 0rbit data bus. 
[0073] The signal processing circuit (Image Processor) 216, which-isan image. processing IC, receives a control 
signal 221 from the CPU 29 via the camera microcomputer 211. The signal processing circuit 216, therefore, uses the 
control signal 221 to perform read/write operations to an internal register. (not shown), thus carrying out such image 
io processing as white balancing, AE, etc. - 

[0074] Specifically, the signal processing circuit 216, according to the sample clock signal 228 from the timing gen- 
erator 218, performs correction such as white balancing on the digital data from the A/D converter- 21 5 and converts 
the resultant data into a RGB-based color space from the color space at the imaging element 21 3 as YUV 8-bit format 
image data 39 and then- supplies Ht to the CPU^29 via an 8-bit data bus.. 
is ■. . . - . - • r 

Sub-CPU unit 202 

[0075] The sub-CPU unit- 202, as shown in FIG. 5 above, comprises a sub-CPU 1 with which it communicates with 
the main-CPU 201 , the PHS unit 203, and the above-mentioned camera unit 204. To this sub-CPU 1 are connected a 
20 black/white LCD (LCD display) 104, a jogdial 11', a keyboard 103 : a mode dial 101 , a shutter button 102, an RTC 4, 
a DC-DC converter 24, and a battery 22. - ■:• ; • 

[0076] The sub-CPU unit 202 as mentioned above has the following functions. * < 

(2-10 . • • ' : — v,: 

25 

[0077] The sub-GPU1 communicates with the.CPU 29oftfcie main-CPU; unit 205 , to send and receive 'Commands 
-.. and data. . .- . . . * ., . - .'»*■«:. -}i'oc \o : fovj -w ; bobivvu. aih t»; : 1 

[0078] This; communication is specifically carried ouLrin parailehtransfer byurtrieiarfs of a bus 3*9 comprising 1 3. signal 
wires. The bus 19. comprises an 8-bit data bus,, a one-bit^addressvsignal wire,. .an I/O READ signal wire; an I/O WRITE 
30 signal wire, a Chip Select signal wire, and an INTERRUPT signal wire. - : , • - : 

[0079] Also, the sub-CPU ^supplies a Reset Request signal; Resetter thei main-CPU tinit 201 to the CPU-29;via a 
signal wire 21 .-. . i . * * . :: ~0 f • ■ • • • v. v 

[0080] Further^the <sub L CPU1 supplies a Reset Request signal Beset for control over the camera unit 204 to the 
camera microcomputer 51 via a signal wire 21. < ■' k \ o- 1 i: :z.:rw."> s • • .-. . v.. .i vo- < •-• • 

(2-2) • - ft- v:."i* J ■«•;:-" . »:.• r-'f;rr;:ii 0 . ; f b *• ■ « 

[0081] The sub-CPU 1 communicates with the PHS unit 203, to send and receive commands and data.. 
[0082] This communication is specif icaily carried outin serial transfer by means of a signal .wire for serial data transfer 
40 signals. (TxD, RxD), a signal wire 17 for a RING signal;* and-a. signal wire i1 8 -for a : Wake Up.signal 

[0083] Also, the sub-CPU1 supplies a Reset Request signal Reset for the PHS unit 203 to-the PHS module 48 via 
a signal wire 18. " r."-. t : c:vv ;•'■*■ • ivv> ;s --i ;..r • s.-«-*:*r "i 

(2-3) " " * « : »V M--.I -,- , 1- r 'V 

45 .: • •. -..^ jl • f • ■ - 

[0084] The sub-CPU 1 controls the display operation on the black/while LCD 104 by sending in serial transfer the 
commands, data, etc. to thelblack/white LCD 1.04 via a signal wire 3 for-the CS signal, the RS signal, the SDA signal, 
and the SCL signal. . ; > - 

[0085] Also, the sub-CPU1 supplies a BL-ON signal to the black/white LCD/I 04 via the signal wire 3, thus controlling 
so the ON/OFF operations of the backrlight element (not shown) of the black/white LCD 104. • : z. -'.:<> 

(2-4) • . i.i^'.. •« - • i' ■ k • >-:, ■ , • r « 

[0086] The sub-CPU1 is connected with the RTC 4 via an I2C-BUS (Inter IG BUS:, proposed by Philips).'The RTC 4 
55 is for generating calendar or time information etc. Also, the RTC 4 ope rates on an ope rational clock signal of for exam pie 
32.768 kHz, which is supplied to the PHS module 48 via a signal wire 49. The FTTC.4 such as mentioned above permits 
the sub-CPU1 to obtain the information of date, time, etc. * . .*. ■ 

[0087] Also, the sub-CPU! receives at its interruption terminal IRQ an alarm signal from the RTC 4 via a signal wire 
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6. With this, the sub-CPU 1- .can. generate interrupts; at a predetermined point in time.. . v . 
(2-5) 

5 [0088] The sub-CPU1 detectsthekey-in operations by the mode dial 101 , the shutter button 102, and the keyboard 
103. 

[0089] Specifically, the suB-CPU1 detects the operational state of the mode dial 1.01 (mode transfer switch), thereby 
identifying tour modes of the above-mentioned OFF mode (powe: 7 off mode), TEL mode (telephone mode), VIEW mode 
(reproduction mode), and CAMERA mode (camera mode). For this purpose, the sub-CPU 1 is connected with the mode 
io dial 101 by means of four signal wires (switch input terminal) 8. 

. [0090] . Also, the sub-CPU1 detects the operational state of the shutter button 102 (shutter switch). The shutter button 

102 consists of 2-stage switch coming in a half-depression state and full-depression state. The sub-CPU1, therefore, 
identifies whether the shutter button 102 is in the half-depression or fullrdepression state. For this purpose, the sub- 
CPU1 and the shutter button 102 are interconnected with two signal wires (switch, input terminal) 10. 

75 [0091] Also, the sub-CPU1 detects the operational state of thejog dial 11 The jog dial 11 is used for example to 
select desired ones of a plurality of items displayed on the screen of the black/white LCD 104. For example, the user 
can operate the jog dial 11 to move the cursor on the display screen of the black/white LCD 104 and then depress the 
jog dial 11 when that cursor is positioned on the desired item, thus determining that, item. Also, the jog dial 11 can be 
configured so as to be inclined to right and left, thereby switching the display of the black/white LCD 104.. When, for 

20 example, the jog dial 11 is inclined to the left, the previous screen is recovered and when it is inclined to the right, the 
following screen appears. Such behavior involved in the operations of the jog dial 11 is controlled by detecting the 
; operational state of the jog dial 11 by the sub-CPU1. Therefore, the.sub-CPU1 and the jog dial 11 are interconnected 
- by means of a total of five signal wires (switch input terminal) 12 including two signal wires for deciding the rotation 
direction of the jog dial 11, one signal wire for deciding the depression of the jog dial, and two signal wires for deciding 

2S its inclination to either left op right., _ / 

[0092] Also, the sub-CPU 1 detects:.the operational state of the keyboard 103. The keyboard 103, which :is used as 
an alphanumeric keypad for the entry, of- telephone numbers, comprises switches in an 8x2 key-matrix. The keyboard 

103 is, therefore, scanned from the sub-CPU 1 by means of eight output signal wires (output terminal) .14 and two input 
signal wires (input terminal) 15. . • > f ■ , 

30 [0093] The above-mentioned mode dial 101 , the shutter button 102, the keyboard 103, and other keys of various 
types are provided with a special input terminal so arranged as to receive interrupts when an input has changed. For 
this purpose, when the sub-CPU1 is in a stand-by. state because there is no job to execute, it shifts automatically from 
the stand-by state to a full-on (Full -On) state upon changes in key-in operations, thus performing control necessary to 
conduct according to changes in entry. 

35 . • .. . Vl •... >. . . ' 

■ (2-6) - ■ : 0 v;L:, i :. , — . • . ' , \- . '■ : . . " , 

[0094] The sub-CPU1 is interconnected with a battery 22 by a signal wire 26, with which it performs serial commu- 
nication by means of RxD. For example, the sub-CPU1 receives the. information such as the remaining energy of the 
40 battery 22 and the states of the battery as re-charged (voltage, temperature, etc.) and, based on the information, 
conducts control processing. ...... « . % , - » ■ >. r 

[0095] Note here that the battery 22 feeds its power to various units of the sub-CPU1 via the DC-DC converter 24. 
With this, the sub-CPU1 manages power by controlling the ON/OFF switching of the DC-DC converter 24 via a signal 
wire 25 (output terminal). 

45 . [0096] The battery 22 is provided with an attachment/detachment detection switch 23 interlocked with a knob (not 
shown) of the lid of an output port of the battery 22, the detection signal of which attachment/detachment switch 23 is 
supplied via a communication wire 27 to the sub-CPU T. Eased oathe detection signal from the attachment/detachment 
switch 23, the sub-CPU1 knows that the battery 22 is being pulled out and then turns off the. power, thus performing 
processing necessary to prevent the stored data from being destroyed. 

50 [0097] Also, the output voltage of the battery 22 is supplied to the sub CPU 1 via a signal wire 28 (input terminal for 
A/D converter).. With this, thesub-CPU1 monitors the voltage of the battery 22 and, if it has detected excessive charging, 
over-charging, or other abnormality, performs the corresponding protective processing. 

Main-CPU unit 201 

55,, , - - . . . , . 

[0098] As shown in FIG. 5B above, the main-CPU unit 201 comprises the above-mentioned CPU 29, an EDODRAM 
30 connected to the CPU 29, a flash ROM 31 ;.an ROM 32, and an IrDA module 35 and an IrDALED 36 connected to 
the IrDA module 35 . . . < 
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[0099] Also, the main-CPU unit 201 comprises crystal oscillators 46 and 47' provided to: the CPU 29. 

[0100] As for the main-CPU unit 201 such as mentioned above, first the CPU 29 (CPU chip) has three serial ports 

(Serial Ports 0-2). 

[0101] A signal wire 38 for Serial Port 0 is used for communication with the camera unit 204. The CPU 29, therefore, 
s uses this signal wire 38 to sends to the camera unit 204 those directions about the exposure conditions, the strobe 
109, the photographing mode, photographing timing, etc. 

[0102] A signal wire 37 for Serial Port 1 is used for I rD A communication with the external host computer (not shown). 
The IrD A module 35 here converts serial data given via the signal wire 37 into something for IrDA. It then communicates 
using infrared ray the IrDA-use data obtained at the IrDA module 35 by an IrDALED 36 (driver/receiver). 

w [0103] A signal wire 34 for Serial Port 2 is used for communication with a radio communication unit (not shown). To 
the above-mentioned radio communication unit are given commands from the sub-CPU unit 1 of the sub-CPU unit 202 
and communication data is given from-this CPU 29 via the signal wire 34. Therefore, it is possible to give directions to 
the above-mentioned communication unit or to collect necessary-information without interrupting the transmission dur- 
ing radio communication. For example, it can be used to obtain electric-field intensity information. 

is [0104] Also, the CPU 29 has a parallel interface 19, with which the sub-CPU unit 202 and the main-CPU-201 are 
interconnected. ■ ■ . - - • ' * 

[0105] Further, the CPU 29 performs image capturing, image signal interpolation and thinning out; outputting of 
display to the black/ white LCD 104 and the color LCD 1C7, communication with the camera microcomputer of the 
camera unit 204, the sub-CPU 202, the above-mentioned radio communication unit, and the above-mentioned .external 

20 host computer, protoco! processing usually used in Internet such as TCP/IP, and execution of E-mails and user appli- 
cations such as WWW. • 1 c ■ f 

[0106] For this purpose, the CPU 29"is provided with an interface 39 and a display, interface of the camera unit 204 
-as well as not-shown serial ports, memory interfaces, parallel interfaces, genera I -purpose lO's (hereinafter called 
GPIO's), an ALU, cache memories, DMA controllers, timers, and compression/extension engines. 

25 [0107] The details of the interface 39 of the camera unit 204 and the display, interface 41 are described later. 

[0108] Interrupts can be caused by the camera unit 204'siintepface and display. interface, the timer, the: DMA controller, 
the GPIO, the serial interface,- the parallel interface, an ctt he compress ion/extension engine when; each of these changes 
in its operation. : . .- ^ .,..« v.- ■ f> *\ v o , ?•? j^r ari r *C:i bs'iv ■ w •« 

[0109] As DMA channels are allocated the camera unit 204's interface and display interface, the serial interface, and 

30 the compression/extension engine, sothat data can be transferred once the ;data is provided, without intervention of 
the ALU. - . -.iL-. .. ■ •> i . -M---!.--; **. **■ ' » • : * . 

[0110] The EDODRAM 30 is used as a work area of theOS or the application software. Here it. is supposed that the 
EDODRAM 30 comprises for example two~ 16 N/Nb it (1 M x*>1 ey.EDODRAM's Which operate on 3.3 V. 
[0111] Note here that the EDODRAM 30 supports the self-refresh mode,,thus>shifting intoa low-power<iissipation 

35 state under the control of the memory controller (not shown) of the CPU 29. 

[0112] The flash ROM 31 is for example of an NOR type and connected, as a hardware interface, in the same form 
as usual SRAM's. 

[0113] The flash RCM 31 is used to preserve images obtained by photographing at the camera unit 204 and record 
called E-mails, data obtained through ftp T communication . audio datafrom the microphone connected to the PHS unit 

40 203, and various parameter data. . , . : r ?.. 

[0114] Data is written into the flash ROM 31 according to the protocol given by the software program executed in 
the CPU 29. ... ; ■ . : . • ■ V- 

[0115] The ROM 32. consists for example of 16M-bit mask ROMs, to store the OS and the application software 
programs themselves. ■• " • 

45. [0116] -When the CPU 29 is released from the reset state upon power application, the ROM 32 is selected to execute 
the boot strap code. 

[0117] The crystal oscillators 46 and 47 are used to generate frequencies used in .the CPU 29. 
[01 18] The crystal oscillator 46 generates frequencies used to control the entire system and to perform NTSC coding. 
The crystal oscillator 47, on the other hand, generates frequencies used to obtain data (data input) from the camera 
50 unit 204. . : • - ; ; ""• ' 

[0119] These crystat oscillators 46 and 47 are so configured as to enter the oscillation-step mode in the low^power- 
dissipation state. • " .«« 

[0120] As mentioned above, the camera unit 204's interface 39 is used to store image data sent from the camera 
unit 204 into the flash ROM 31 . 
55 [01 21] Note here that the above-mentioned image data is the 4:2:2 format data obtained by performing, at the signal 
processing circuit 216, color space conversion, image interpolation, auto-white balancing, and auto-focus control and 
other image processing on the image data (CCD Raw data) obtained by photographing at the imaging element 213. 
With this, therefore, a sampling frequency which is twice the above-mentioned CCDRaw data is required. 
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[0122] For this purpose, the CPU 29 sends the horizontal synchronization.signal HD and the vertical synchronization 
signal VD to the camera unit 204 's signal processing circuit 216 and the timing generator 21 8 via a signal wire 40. With 
this, the image data can be stored* into the flash ROM ,31 at timing-synchronized with the operation of the camera unit 
204. . . . • • >- • . 

5 , [01 23] The display interface 41 is used to send NTSC signals provided by the CPU 29 to an external connector 42 
and an LCD controller 53 of the color LCD 107 (LCD). 

[0124] The LCD controller 45, therefore, supplies NTSC signals provided from the display interface 41 to the color 
LCD 43 via a voltage conversion device 44. 

[0125] The above description has explained about the main-CPU unit 210, the sub-CPU unit 220, and the camera 
10 unit 240 which are the main components of the digital camera 100. 

[0126] Next, how the digital camera 100 is controlled in operation of photographing etc.; is described specifically. 

Control of photographing in CAMERA mode 

15 [0127] The ROM 32 beforehand stores for example programs according to a flowchart shown in FIG. 7, which pro- 
grams are read out by the CPU 29 and executed, thus performing the following photographing in the CAMERA mode 
of the digital camera 100. 

[0128] First, when power is applied to the digital camera 100 by the mode dial 101 or when the CAMERA mode is 
entered (step S501 ), a capacitor for emitting light from the strobe 109 starts to be charged (step S502). This operation 
20 is performed for preparation that the strobe canemit light in the CAMERA mode or immediately after the strobe pho- 
tographing mode is entered. 

•, [0129] Next, the camera microcomputer 211 (CCD module containing the controller) which controls the camera unit 
204's imaging element 213 etc. .is enabled. (step, S503) ad then, the color LCD 107 starts its operation to function as 
an electronic view finder (EVF) to confirm a subject (not shown) in photographing (step S504). 
2S [01 30] When photographing is started, the consecutive processing through displaying images fetched from the cam- 
era unit 204 onto the color LCD .107 is performed according to the following processing steps. ! -r \ 
[0131] First, optical information of. the subject fetched from the lens 108 is converted by the imaging -element 21 3 
into an electric signal (photoelectric conversion) (step S505). 

[01 32] The output signal from the imaging element 21 3 is interlaced analog signal of thinnedout compact-sized data 
30 with 320 x 240 dots, not the whole data of 640 x 480 dots. 

[0.1 33] Next, the signal obtained at step S505 is sent to the signal processing circuit 21 6, where the signal undergoes 

the above-mentioned image processing (step S506): ...... 

[0134] That is, it undergoes such image processing as auto-white balancing, AE, correction at photographing by the 

strobe 109, and conversion into a YcrCb (4:2:2) format. . , 
35 [0135] ; Also„the signal (signal converted into the YcrCb format) obtained at step S506 further undergoes by software 

the correction of errors in- the aspect ratio due to differences in the processing frequency and the output image signal 

for the color LCD 107 (EVF) and Endian conversion (step S507). ; 

[0136] Next, the signal which has undergone various types of processing at steps S506 and 507 is converted into 
an NTSC signal by the NTSC encoder (not shown) (at step S508) and supplied to the LCD controller 45 of the color 
40 LCD 107 (stepS509). 

[0137] The color LCD 107, therefore, uses the EVF to display the image of the subject based on the output signal 
from the LCD controller 45. 

[0138] Various types of processing at steps S505 through S510 is performed consecutively at a 1/30 second cycle, 
thus permitting the color LCD 1 07. to monitor the subject image always. 
45 [01 39] With this, when the photographer has depressed a key during the monitoring by the color LCD 1 07, a resultant 
detection signal causes an interrupt event, thus making a shift to interrupt processing A. 

. (1-1) Interrupt processing A 

so [0140] Example, a program.corresponding to a flowchart shown in FIGS. 8A and SB is pre-stored in ROM 32. The 
following interrupt processing (interrupt processing by key operation) is performed by reading and running the program 
by CPU 23. At point in time when this key-in operation has occurred, the.system is internally in either of two modes. 
One is a usual mode, in which as shown in FIG. 7 above : image monitoring is consecutively performed from the time 
of power application The other is a half -depression mode, in which the shutter button 102 is once half-depressed with 

55 various camera settings being locked, to permit images to be monitored. , 

[0141] Here, the processing start position is described by dividing it into the processing from the usual mode and 
. that from the half-depression mode: .. .. 
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(1-1-1) Interrupt processing from usual mode V : ..-.I: * : • • 

[0142] First, key status for detecting which key has been depressed is read in (step S521). ; * 

[0143] When it is decided based on the key status fetched at step S521 that the shutter switch 102 has been operated 

5 (step S522), various camera setting " in the signal "processing circuit 216 such as auto-white balancing, AE, strobe 
correction in strobe 109 photographing, etc. are locked at the- present set-points (step S523) arid then, the color LCD 
107 (EVF) is stopped in operation to reduce the processing load due to the CPU 29 (step S537). 
[0144] Next, although the above-mentioned processing of monitoring images involved only compact -sized dot num- 
bers of signals, here as photographed images, a full-image of capture signal of a VGA standard (640 x 480 dots) is 

10 fetched and undergoes predetermined image processing at the signal processing circuit (image processor) 216, to ' 
store the YcrCb format data in'the EDODRAM 30 (step S533). * ■ 

[0145] The data stored in the EDODRAM 30 at step S538 undergoes image compression processing according to 
the JPEG standard (step S539), and thus compressed data is written as an image file in the flash ROM 31 (step S540). 
[0146] Then, the color LCD 107 is shifted from the stop state to the operative state (step S541), to display for a 

15 predetermined lapse of time the image file written in the flash ROM 31 on the color LCD 107 for confirmationVof the 
photographed images (step S542) and then finish this interrupt processing (step S543)> in order to return again to the 
loop processing in FIG. 7 above for re-starting the monitoring of images. * '* - 

.[0147] On the other hand, when it is- decided based on the key status fetched at step S521 that a key has been 
depressed for play-back operation (step S524), the- later-described play-back function B is performed. ■ - 

20 [0148] Also, when-il is decided based oh the key slatusfetched at step S521that the shutter button 102 has been 
half -depressed (step S525), the internal state setting is set to the half -depression mode (step S526) and, ; in the same 
way as the above-mentioned step S523; various camera settings in the signal processing- circuit 216 such as auto- 
. white balancing, AE; strobe correction in strobe 109 photographing, etc. are locked at the current set-points (step S527). 
[0149] Then, this interrupt processing is finished (step S528)y to { return again to the loop processing in FIG. 7 above 

2S .for re-starting. of image monitoring. rs. . , o. : ... v\ ... 

[0150] When, also; it is decided based' on the key ^status f etched ratestep S52t»that akeyhas been depressed for 
changing the photographing conditions (step S529), various: earrte'raJsettinlj^ 

as auto-white balancing, AE, strobe correction in strobe -^G&phdtogiraphittg, "etc; -^fe re-set according to the changes 
in those conditions (step S530), to finish this -interrupt "processing (step S528) In -order to return again to thejoop 

30 processing in FIG. 7 above for re-starting image monitoring. ri.-.i. ; o. . . n . ~, 

[0151] When, also, it is decided based on the key status fetched at step S52f ! that a key has been depressed for 
turning power off (power-OFF) (step S531), the color LCD 107 is fintshedyn operation >(step S532) and then the above- 
mentioned CCD moduJe is also finished in operation (step.S533) consecutively and then other photographing operations 
are also finished to turn off the system power (step S534): ^ a -. * : "? ■-• • ° . < : ; 

35 [01 52] If ,.on the other hand, it- is not decided at step S531 that a'key has been depressed for tuning power* off (power- 
OFF), it is recognized that no valid, key has- been depressed; toperform no processing in order to finish this interrupt 
processing (step S528) and return again to the loop processing in FIG» 7'above for re-starting image monitoring. 

(1-1-2) Interrupt processinglahalf -depression-mode v :-- ! ; : r? ' ; *a 

40 .Jti- i-' ; 

[0153] First, key status is read- into detect which .key «has been operated (step S535). • i. , ■* * 

[0154] When it is decided based on the key status fetched at step S521 that the shutter, switch 1 02 has been operated 
(step S536), the system performs processing starting from the aboveTmentioned step S537, leaving as validated those 
various camera settings (step S527) in the^signal processing circuit 216 which ware- locked upon detection of the 

45. previous half-depressed key (step S525). * v >v».>- ■ \ • 

[0155] When, on the other hand, iris decided based on thekey status fetched at step S521 that the shutter switch 
1 02 has been released from the half-depression state (step S545) : the internal state settings are released from those 
given in the half-depression mode (step S546), to finish this interrupt processing (step S528) in order to return again 
to the loop processing in FIG. 7 above for re-starting image monitoring. 

50 [0156] . If, also, it is decided based on^the key status fetched at step S521 that the shutter switch 102 is not^released 
yet from the half-depression state. (step) 545), it is recognized that -no valid key has been '-operated; to perform no 
processing and to finish. this interrupt processing. (step.S528) in order to return again to the loop processing in, FIG. 7 
above for re-starting image monitoring^ u 

■ ■ . - . . . • v . 

55 (1-2) Processing of play-back function B ? 

[0157] This processing of the play-back function B is executed when it is decided that a key has been operated for 
a play-back function, at the above-mentioned key-operation decision processing (step S524). 
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[0158] The play-back function 'here -mean's a function to have actions on photographed images immediately after 
being photographed by the camera without switching the mode, such as the addition of audio information etc. (audio 
addition function), the transfer of image information by use of E-mails (mail transfer function), the deletion of images 
(image deletion function), etc by simple key operations 
5 [0159] For this purpose, the ROM 32 beforehand stores for example those programs according to the flowchart 
shown in FIG. 9, which programs are read out by the CPU 29 and executed, thereby performing the play-back function 
B as described below. 

[0160] First, it is decided whether there is an immediately photographed image or not (step S551 ). 
[0161] The immediately preceding image means a photographed image validated until any other function is per- 
10 formed such as mode switching immediately after photographing was performed by the operation of the shutter button 
102. 

[0162] When, as a result, it is decided that there is no immediately preceding image, no processing is performed to 
finish this interrupt processing (step S560) in order to return again to the loop shown in FIG. 7 above for re-starting 
image monitoring. 

75 [0163] When, on the other hand, there is ah immediately preceding image, in the same way as the above-mentioned 
processing at steps S507 through S510 shown in FIG. 7 above, first that immediately preceding image stored in the 
EDODRAM 30 undergoes by software such processing as correcting errors in the aspect ratio due to differences in 
the processing frequency (step S552). ■*■ ':• - . ■ 

[0164] Next, the signal processed at step S552 is converted by the NTSC encoder (not shown) into an NTSC signal 
20 (step S553) and supplied to the LCD controller 45 of the color LCD 107 (step S554). 

[0165] On the color LCD 107, therefore, the immediately preceding image of the subject is displayed on the screen 
by the EVF based on the ; output signal from the LCD controller (step S555) 

[0166] Then, the type of a play-back function selected by the photographer is decided (step S556), to branch to each 
-processing/ < * . . 1 r 

25 [0167] : < That is, if the audio addition function is selected, the audio' addition processing is performed (step S557); if 
the mail transfer function is selected, the mail transfer processing is performed (step S558); and-if the image deletion 
function is selected; r the deletion processing of photographed images is performed (step S559). 

(2) VIEW mode (image display mode) ' '* 

[0168] The VIEW mode is entered to reproduce (display) imagesobtained by photographing. 
* [0169] ' For this purpose, the ROM 32 beforehand stores for example those programs according to the flowchart 
shown in FIG. 10, which programs are read out by the CPU 29 and executed, thereby performing the following oper- 
ations in the VI EW mode of the digital' camera 1 00. : 

35 [0170] First, when power is applied to the digital camera 100 by operating the mode dial 101 or the system is switched 
into the VIEW mode (step S571); the color LCD 107 starts to operate as behaving as an electronic view finder (EVF) 
to confirm a subject during photographing (step S572). ^ ( . , 

[0171] Next, by the write-in processing for photographed images shown in FIG. 8 above (step S540), compressed 
image files written in the flash ROM 31 (step S573) and the images are uncompressed, that is, the compressed data 

40 according to the JPEG standard is converted into the Original data (YcrCb format -data) (step S574). 

[0172] Then, the original data thus obtained by uncompressing at step S574 is written into the EDODRAM 30 (step 
••• S575). •• : - ' ■ m - - ■ ■ ■ ■ 

[0173] Subsequently, in the same way as the processing at steps S507 through S510 shown in FIG. 7 above, the 
original data (image data) written in the EDODRAM 30 undergoes by software such processing as correcting of errors 

45 in the aspect ratio due to differences in the processing frequency (step S576) and is converted into an NTSC signal 
by the NTSC encoder (not shown) (step S576) and supplied to the LCD controller 45 of the color LCD 1 07 (step S578). 
[0174] On the color LCD 107, therefore, selected images designated by the EVF are displayed on the screen base,- 
on the output signal from the LCD controller 45 (step S579). 

so (3) Control of operations at time of E-mail transmission and reception 

[0175] The ROM 32 beforehand stores for example those programs according to the flowchart shown in FIGs. 11 
through 1 3, which programs are read out by the CPU 29 and executed, thus performing the following operations required 
for transmission and reception of E-mails by the digital camera 100. 

55 

(3-1) Establishment of link 

[0176] For example; a link is to be established for TCP/IP of the point-to-point protocol (PPP) utilizing a telephone line. 
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[0177] That is, as shown in.FIG. 11 above, first an AT command is executed;to.start ; the connection processing for 
the telephone line (step S58:1). !.-■'. »>-.-. > v .n m • • , - 

[0178] Next, it is decided iwhether the telephone line connection. has beep, established or not (step S582) and. if it is 
established, the TCP/IP connection processing is started according to the PPP (step r S583). ■.- . . , . 

5 [0179] Next, link is established for data link layers according to-the link controi protocol (LCP) (step S584). » 

[0180] Next, whether user authentication is required or not is decided (step S585>and, if it is required, the user 
authentication protocol is performed (step S586). 

[0181] If user authentication is not required or when user authentication is required; and the user authentication 
protocol is performed, the setting is confirmed according to the network control protocol (NCP) (step S587). . 
10 [0182] Next, connection is established according to the PPP (step S588), to establish connection according to the 
LCP (step S589) and finish this processing. 

(3-2) E-mail transmission • , ; 

is [0183] When, for example, an E-mail is sent according to the simple mail transfer protocol (SMTP),, as shown in FIG. 
12 above, first an SMTP client (hereinafter simply called client) issues- a connection request toan.SMTP server (here- 
inafter simply called server) for the transmission of. the E-mail (step S591). ...... ... 

[0184] When a server is connected in response to this connection request, the server returns to the client a response 

code indicating connect ion -OK. . . : - ■ »■ _ 

20 [0185] The client, when it has recognized the reception of this response code (step S592), uses a Helo command 

to notify the server of its own domain name, thus declaring the start of using to the serven (step S593). 

[0186] Subsequently, when the server can recognize the domain name of the client, a response code indicating 

normality, and the domain. name, of the server are returned to the client: . , : % 

[0187] When the client recognizes that the response code and the domain name of the server are sent (step S594), 
25 » v ;From information is .transmitted to the. server by MAIL command, ,and*the user ; name (address) of a transmission end 

is designated to declare : thejstart of electronic mail. transmission tpjhe server (stQp S595). . : 

[0188] Next, when the server receives From information and the. user name, of the transmission end from, the client, 
and recognizes that preparations are made for receiving the mail and that there is no error in the user name (address) 
of the transmission end, the server returns the response code indicating normality to the client. .. , - 

30 [0189] When the client recognizes that the response code is transmitted (step S596), the addressee of the mail is 
designated for the server by RCPT command (step S597); : . et . * . . ... *. i , - / 

[0190] Additionally, when the.mail is transmitted to a plurality of persons; a pjurality of mail . addressees are designated 
in step S597. -. . . • ..• - , *. ■ - , fc .• v! .^ y .. "■ 

[0191] Subsequently, the server judges whether the server can handle the addressee of the mail designated by the 

35 client.. When the addressee can be handled, the response code indicating normality is returned to the client. Moreover, 
when it cannot be handled, a code indicating transfer to another SMTP server is returned.. 

[0192] When the client recognizes that the response code indicating normality is transmitted (step S598), it is declared 
. by DATA command that mail text is transmitted to the server (step S599). : ■. • ; , \ : 

[0193] . Subsequently, when the server receives the, declaration of rnai! text transmission from the client. and is pre- 
40 pared for reception, the response code (response code 354) indicating permission for thamail transmission is returned 

to the client.; -. • . . . - \ • .t ■ ; . . .- .- - " 

[0194] When the client recognizes that the response code is transmitted (step S600), the mail text to be transmitted 

is transmitted to the server (step S601 ). Then, the client declares the end of the mail text transmission by transmitting 

codes such as <CR> <LF>, <CR> <LF> to the server (step S602). . . : . 

45 . [0195] Next, in response to the declaratiornof-the mail text transmission end from the client, the server returns to the 

client the response code (response code 250) which indicates that request is normally completed. _ ■ . 

[0196] When the client recognizes that the response .code is transmitted (step S603), the transmission, end of the 

electronic mail by SMTP is declared to the server by^QUIT command (step S60.4). ... 

[0197] Additionally, in the embodiment, image file (image file obtained by photographing, received image file, and 
50 the like) may be attached to the mail text. . 

[0198] Subsequently, in response to the declaration of the end from the client, the server returns the response code 

indicating the end to the client. . . , . ; c - r . : ■ • 4 ; 

[0199] When the client recognizes that.the response code.is transmitted (step S605), TCP connection is cut, thereby 

ending the present processing. ... 

55 

(3-3) Electronic Mail Reception 

[0200] For example,. when the reception of electronic mail is performed by POP 3 (Post Office Protocol Version 3), 
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as described above, first, POP client (hereinafter, referred to just as the client) issues a request for connection to receive 
the electronic mail to POP server (hereinafter referred td jusf as the server) (step S611) 

[0201] Subsequently.the server returns a response code indicating that connection is OK and a server name to the 
client (step S611). ; • : 

5 [0202] When the client recognizes that the response code and server name are transmitted (step S612), by USER 
and PASS commands, a user name and password for user authentication-are returned to the server (step S613). 
[0203] Subsequently,' when the server can confirm the user name and password from the client, the response code 
indicating normality is returned to the client. 

[0204] When the client recognizes that the response code is transmitted (step S61 4), mail box information is request- 
io ed to the server by STAT command (command indicating a request for mail box reception state information such as 
the number of mails), or LIST command (command indicating a request for list information of mails present in a mail 
box) as occasion demands (step S61 5). 

[0205] Subsequently, in response to the request the server transmits the mail box information to the client, 
[0206] The client requires a necessary mail for the server by RETR command based on the information from the 
is server (step S61 6). 

[0207] Subsequently, the server transmits the mail required from the client to the client (step S617). 
[0208] The client receives ; the mail from the server, and judges whether or not all necessary mails are requested to 
the server (step S618). When all the mails are not requested, the processing returns to the processing of step S615, 
and repeats the subsequent, processings. . 
20 i [0209] When the client finishes requesting all the necessary mails to the server, the client allows the server by QUIT 
command to execute an update processing of the mail box, and declares that the reception of the electronic mail by 
POP 3 is ended (step S61 9). 

; [0210] Subsequently, in response to the end declaration from the client, the server returns the response code indi- 
cating the end to the client. . 

2S ■ [0211] When the client recognizes that the responsecode is transmitted (step S620), POP 3 connection is cut; thereby 
ending the present processing^ , < ■• ! . ..... ,;_. t it 

. [0212] In the digital camerafipo which hasyaripus f unctions as described above, and is constituted to perform various 
operations, when the most characteristic control flow is replaced with conceptual blocks; a constitution, for example, 
as shown in Fjg. 14 is obtained. 1 ... 

30 [021 3] Specifically, the digital camera 1 00 is provided with a communication unit 301 , a received amount calculating 
unit 302 and a data storage unit 303 to.which outputs of communication unit 301 are supplied, a memory 304 to which 
an output of data storage unit 303 is supplied, an image input unit 305, an image compressing unit 306 to which an 
output of image input unit 305 is supplied, and an image storage unit 307 to which an output of image compressing 
unit 306 is supplied. An output of image storage unit 307 is also supplied to the memory 304. 

35 [0214] The digital camera ; 100 is also provided with a memory remaining amount calculating; unit 309 to which an 
output of memory 304 is supplied; an input unit.31.-0; a photographing mode setting unit 311 to which an output of input 
unit 310 is supplied; and a control unit 308 to which outputs of the above-described received amount calculating unit 
302, memory remaining amount calculating unit 309 and photographing mode setting unit 311 are supplied, and an 
output of control unit 308 is supplied to the image compressing unit 306 and the communication unit 301 . 

40 ; [0215] -Here, first the communication unit 301 corresponds to the.PHS unit 203. 

[0216] The received amount calculating unit 302 is realized by the software which is executed in the CPU 29 of the 
main CPU unit 201 1 The received amount calculating unit 302 uses, communication protocol to. calculate the data 
amount of data ; estimated to be received by the communication unit 301 (estimated amount of received data). 
[0217] The data storage unit 303 stores the data received by the communication unit 301. into the memory 304 using 

4c ■ a file system. > .... 

[0218] The memory 304 corresponds to the flash ROM 32 (nonvolatile memory) of the main CPU 201 . 
[0219] The image input unit 305 corresponds to the entire camera unit 204 which has the above-described consti- 
tution. ■ :»•.,. .. 

[0220] The image compressing unit 306 is incorporated in the CPU 29, and is constituted so that compressed image 
so data size can be adjusted by changing a quantization.table. 

[0221] Table d shows examples of photographing modes handled in the present apparatus, image sizes obtained 
by the photographing modes, and quantization table numbers foruse, ,. . . 

. ,. ... .. " " . ' Table 1 



Photographing Mode 


Typical Size 


Quantization Table 


Economy 


25 KB 


4 
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Table 1 (continued) 



Photographing Mode 


Typical Size 


Quantization Table 


Normal 


50 KB 


3 


Fine 


100 KB 


2 • " ' * " 


. Super Fine 


. 200 KB 


1 



70 



75 



20 



25 



30 



35 



40 



45 



50 



55 



[0222] As shown in Table 1, here, the photographing modes are set to Economy mode, Normal mode, Fine mode, 
and Super Fine mode, the sizes of the image data obtained by the photographing modes are 25 KB, 50 KB, 100 KB, 
200 KB, the numbers of the quantization table for use are "4", "3", "2", and "1 " ; and these are classified into four stages. 
[0223] The image storage unit 307 stores the image data compressed by the image compressing unit 306 into the 
memory 304 by the CPU 29. : ' Ai 

[0224] The control unit 308 is realized by the software of the CPU 29,'and performs the operation control of thVentire 
apparatus. 

[0225] Particularly, when it is judged by an indication from the memory remaining amount calculating unit '309 that 
the remaining amount of the memory 304 is small, control is performed to transmit the data estimated to be received 
to an external apparatus. ' - r 

[0226] Additionally, in the above-described case, by changing parameters sucrras the quantizationUable in the image 

compressing unit 306, compressing control may be performed. Specifically, when it is judged by the indicaticnVfrom 

the memory remaining amount calculating unit 309 described later that the remaining amount of the memory 304 is 

small, this is notified to the image compressing unit 306 to change the compressibility in the image compressing unit 306. 

[0227] The memory remaining amount calculating unit 309 is realized by the software of the CPU 29, and uses the 

table of the file system constructed on the memory 304 in calculating the remaining amount of the memory 304. 

[0226] The 'input unit 310 corresponds fo ; input swrtcnes such-as the mode<Mal' TO U' Spec if really, the unit- is used in 

the case where a photographer indicates the photographing mode and in other case's. V^-i 

[0229] The photographing mode setting'uriit 31 1 set's the'photbgraphin^ K^b'tiy ri^^ftgltt&^tafte'of the mode dial 

'101 (input unit 310) to the CPU 29 by the sub GPU 1 bfthe sub ,; CPLPunit ! 202 - ! :or ' J — 1 - 

[0230] A processing by the software for implementing the most characteristic operatlon^in'the" digital camera 1 00 as 

described above will be described hereinafter. , : ; ' " ' : 1 ■' ■ 

[0231] A program according to a^flowchart, for example' shown in Fig. 1*5 is stored beforehand in the ROM'32 of the 

main CPU unit 201 , and the program is read and executed by the CPU 29,- so thSt the digrtat camera TOO operates as 

follows/ iV ■ • '■ :s ' : *-V' • ■>! -fc :* s i'' i»j.-:pi *. . ■ . 

[0232] First, it is judged 5 whether 6r not the communication unit 301 (PHS unit 203) is in a" reception called state (step 

S631), and it is judged whether or notthe image input uriit { 305 (cam^ (step S632). 

[0233] When these judgments result VnHhe reception called statd a*nd the ! photographing state,: the processing steps 

from the next step S633 are executed. "* ~ - T - v; * ,{; hi ''- ' * 5 ,J s ' ' : - 

[0234] Additionally/when the unit" is not' in : the reception* calledstate %v the step S631 , the present processing is 

ended to perform a us ual photographing' control. ;l nthe-t rah smissidn, since communication timing can be determined 

under control, photographing timing can be avoided." Moreover, when the photographing state is not judged faV the step 

S632, the present processing is ended to perform the us ual-phofocj raping control. • " 1 

[0235] Moreover, the judgment of the step S6 32 concerning whether , or : nbt : the unit is in the photographing state is 

performed by detecting whether the shutter 'button- 102 is half or completely depressed. Alternatively, it is detected 

whether CAMERA mode is set by the mode dial 1 01. ■ : 

[0236] When the units are in the reception called state and the photographing state, the control unit 308 obtains' 

value A by subtracting the estimated amount of the received data calculated by the received amount calculating unit 

302 from the remaining amount of the memory 304 calculated by the memory remaining amount calculating unit 309 

(step S633). Here, when the value is sufficiently large : the photographed image can be recorded 

[0237] Here, for the estimated amount of the received data, for example, the estimated amount of data obtained by 

receiving E-mail is calculated. Specifically, the above-described POP 3 is used as the communication protocol, and 

the LIST and STAT commandsof POP 3 are used in the step S615 in the program 'as shown in Fig. 13 of "requiring 

the information of plural types for the server 0 to calculate the amount." • • - : : • 

[0238] Subsequently, the control unit 308 obtains the typical compressed image size for the present photographing 
mode set by the photographing mode setting, unit 311 from the Table 1, and subtracts the obtained image size from 
the value A obtained in the step S633. Then, it is judged whether or not the result exceeds the value of predetermined 
amount (step S634). '* ~ \ " " 4 

[0239] The reason why the value. of the predetermined amount is used as offset is that it is difficult to predict the 
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compressed image size in the compression of JPEG system or the like and that only the typical size of the compressed 
image can be predicted By setting; the value of the predetermined amount to be large; it is possible to secure the 
predetermined amount of sheets of photographed, image even after the communication end. However, by recording at 
least one sheet of image, the problem that the photographed image data cannot be recorded because of the received 
s data can be prevented. When one sheet is considered to be little, the capacity for the number of sheets may be secured. 
Additionally, since for the predetermined amount the number of sheets able to be photographed changes by the pho- 
tographing mode, the predetermined amount may be changed in accordance with the photographing mode. In this 
case ; some sheets of. image can be photographed with a desired image quality. 

[0240] As a result of the judgment of the step S634 ; when the subtracted value exceeds the value of the predeter- 
10 mined amount, this indicates that there is an allowance in the remaining amount of the memory 304. Therefore, the 
reception processing, photographing processing, compression processing, and recording processing are continuously 
performed (step S638),:thereby ending the present processing. 

[0241] As the judgment result of the step S634, when the subtracted value does not exceed the value of the prede- 
termined amount, and the. usual control is performed, the remaining amount of the memory 304 for photographing 

is cannot be secured, and the receiving operation cannot be performed. 

[0242] Here, to enhance the reliability of the communication, the data which must have been received (data which 
were to be stored in the memory 304, hereinafter, referred to as "data to be received") is transmitted to another appa- 
ratus. For example, in peer to peer communication, it is not seen whether or not communicatable conditions of com- 
munication partner constantly agree with those of the present apparatus. Therefore, when bidirectional communication 

20 is possible, data is transmitted to a place which can be recognized by the common apparatus. . 

[0243] Therefore, the control unit 308 determines data transmission* destination (step S635). For the transmission 
destination, a predetermined apparatus may be sent, or selection/determination may be performed by a user. 
[0244] When the data transmission destination, is determined, the control unit 308 issues an instruction for data 
transmission (transfer request) to the transmission destination. When the partner side confirms the request, the calling 

25 received in the step S631 is disconnected, and the partner transmits the data to be received to the transmission des- 
tination. In this case, the control unit 308 retains the information concerning the data to be received (the amount of 
memory necessary for: reception, transmission destination, file, name information, and the like) (step S636). ; ; , 
[0245] Thereafter, the photographing processing, compression processing; and recording processing are performed 
(step S637), thereby ending the present processing. ■ 

30 [0246] According to the above-described method, the problem that the generated data cannot be recorded for the 
- . received data can be prevented. , 

[0247] Additionally, the calculation is performed as shown in S633, S646, but the value resulting from S633 may be 
compared with a predetermined value for the calculation. In this case, the predetermined value may be changed in 
accordance with the photographing mode. . ■. 

35 [0248] Additionally, after the photographing, the user of the apparatus secures the remaining amount of the memory 
* 304 for. receivingMhe data to.be received, and communicates with the transmission destination of the data to be received 
to receive the data to be received, in this case, when the size of the data to be received, transmission destination, file 
name and the like held by the step S636 are displayed on the color liquid. crystal display 107, the above -described 
operation can more efficiently be performed, i • . 



40 



(Second Embodiment) 



[0249] The digital camera in a second embodiment has a constitution similar to that of the digital camera 100 in the 
first embodiment (see Fig. 14), but is different in the entire control. : 
45 [O£S0] Specifically, in the embodiment, the communication operation in the communication unit 301 and the photo- 
graphing operation in the image input unit 305 are overlapped. Therefore, when a shortage of the remaining amount 
of the memory 304 occurs, the data to be received is transmitted to another apparatus. Additionally, by receiving a part 
of the data to be received, the instantaneous property of communication is secured.. 

[0251] For this purpose, instead of the program of Fig. 15, a program according to a flowchart, for example, shown 
50 . in Fig. 16 is used. 

[0252] Additionally, in the flowchart of Fig. 16, the processing steps similar to those of the flowchart of Fig. 15 are 
• denoted with the same reference numerals, and the detailed description thereof is omitted. 

[0253] First, it is judged; whether or not the communication unit 301 is in the reception called state (step S631), and 
' it is judged whether or not the image input unit 305 is in the photographing state (step S632). When these judgments 
55 result in the reception called state and the photographing state, the subsequent processing steps are executed; oth- 
erwise the present processing is endedj i . 

[0254]. When the units are in the reception called state and the photographing state, the control unit 308 obtains the 
value A by subtracting the estimated amount of the received data from the remaining amount of the memory 304 (step 



16 

BNSDOCID: <EP 0991260A2J_> 



V 



BP 0 991 260 A2 

S633), the typical size of the compressed irriagefor the* present- photographing-mode is subtracted from the value A, 
and it is then judged whether or not the res utt- exceeds the value*of the predetermined amount. (step S634). 
[0255] As a result of the judgment of the step S634 ; when 1he subtracted value :exceeds the value of the predeter- 
mined amount, this indicates that there is an aHowance inrthe remaining amount of the. memory 304. Therefore, the 
s reception processing, photographing processing, compression processing, and recording processing are continuously 
performed, thereafter ending the present processing. ^. ^ ....-1 

[0256] On the other hand, as the- judgment result of the step S634, when the subtracted value does not exceed the 
value of the predetermined amount, the control unit 308 determines the transmission destination of the data to be 
received as described above (step S635), * v : ' 
10 [0257] When the data transmission destination is determined, the control unit 308 controls the communication unit 
301 to receive a part of the data to be received. v • Zi 

[0258] For example, when the data to be received is document data, only the summary data included in the document 
data is received. Alternatively, when no summary data exists in the document datay new summary data is mechanically 
prepared and retained in the control unit 308. Moreover, in the peer to peer communication, the data of. a title portion 

15 of the data to be received is received. The data partiallyi received in this rnanner is held inside the control unit 308. 
[0259] Subsequently, the control' unit 308 issues a transmission request '{transfer request) to the determined trans- 
mission destination, and controls the communication unit 301 , so that after the request is confirmed, the calling received 
in the step S631 is cut, and the data to be received is transmitted tonne transmission destination (step S641). 
■ [0260] Subsequently, the photographing processing, compression processing, and recording processing are per- 

20 formed (step S637), thereby ending the present processing. ; ~ • c • 

[0261] Additionally, after the photographing, the user of the apparatus secures the remaining amount of the memory 
304 for receiving the data to be received, utilizes the data partially received by the step S641 , and communicates with 
the transmission destination of the data to be received to receive- only the necessary data. " : 

25 (Third Embodiment) :•• . -. o , : , r :. ,:. . ■♦ » 

•• ". ;•" !: - ■' »:-• * * . « i' i: m n'J'C- i-iu it-'V m i c-i • 5 ".-':» 

[0262] The digitaf camera in a third embodiment has a constitution; similar* toithat of the digital^camera 1.00 in the first « 
embodiment (see Fig. 14), but is different in theentire control: -a ■;o^i- p*n ■'• : i-;.r-c r : -n ;( ; • ^ 

[0263] Specifically, in the embodiment, only when reception f rom a specificpartner is performed in the communication 

30 unit 301, the above-described request to the transmission destination is' issued, r .. : ; : . 

[0264] For this purpose, instead of the program of Fig. 15, a program according to. a flowchart;, for example, shown 
in Fig: 17 is used- - : ?>-r,~ : s« •■ > j' > v«j r. ; . • ■;; : r-c 

[0265] . Additionally, in the flowchart of Figv 1 7, the processing steps similar\t0,those of the flowchart of Fig. 15 are 
denoted with the same reference numerals, and the detailed description thereof is omitted) -jr.* 

35 [0266] First, it is judged whether or not the communication unit ;30i1 isjinthe reception.called ; state (step S631), and j 
it is then judged whether or notthe image input unit' 305 is in the photographing state (step S632). When these judgments - 
result in the reception called state and the photographing state- the subsequent processihg:stepsare:executed; oth- - ^ 
erwise the present processing's ended. > r- .r <\- . *. r r •.>.-. ■ * > 

[0267] When the units are in the reception called state and the photographing state, the control unit 308 obtains the 

40 value A by subtracting the estimated amount of the received data from the remaining amount of the memory 304 (step 
S633). Thereafter, the typical size of the compressed image for the present photographing mode is<subtracted from 
the value A, and it is judged whether or not the result exceeds the value of the predetermined amount (step S634). 
[0268] As a result of: the judgment -oMhe step S634 : when theisubtracted value exceeds the.value of the predeter- 
mined amount, this indicates that there is an alfowance in'theremaining amount of the memory 304. Therefore, the 

45 reception processing, photographing processing, compression processing, and recording processing are continuously 
performed (step: S638), thereby ending the present processing. . 

[0269] OYrlhe other hand,, as the judgment result of the step S634, whenthe subtracted value does not exceed the 
value of the predetermined amount, the control unit 308 judges whether or not the. image data is. received from the 
specific partner in the communication unit. 301 (step S651)\ The: judgment is realized, for example, by using the trans- 

50 mission number obtained from transmission number service, grasping the transmission number oMh'e. partner, and 
comparing the number with the transmission number preset by the user (number of the specific partner). \j 
[0270] As the judgment result* of. the step S65 1 , . when the specific partner is not judged, the control: unit 308 controls 
the image input unit 305 to stop the photographing operation. Thereby, the photographing operation is stopped in the 
image input unit 305, and the receiving operation in the communication unit 301 is continuously performed (step S652). 

55 Thereafter, the" present processing is ended: * y . • ♦« 

[0271] In the above-described constitution, the priority of photographing and communication can be controlled in 
accordance with the communication partner; and reception can be performed in preference to the photographing. 
[0272] Additionally, in the above-described control, for example, instead of stopping the photographing operation, 



17 



BNSDOCID: <EP 0991260A2_I_> 



EPG 991 260 A2 

the receiving operation is stopped- and the photographing operation 

[0273] . As the judgment result of .the step S651 , when the specific partner. is -judged, the control unit 308 determines 
the transmission destination of the data to be received as described above (step S636), and performs control to transmit 
the data to be received (step S637).. Subsequently, the photographing processing, compression processing, and re- 
s cording processing are performed (step S637), thereby ending the present processing. 

(Fourth Embodiment) . 

[0274] The digital camera in a fourth embodiment has, a constitution similar.to that of the digital.eamera 100 in the 

io first embodiment (see Fig. 14), but is different in the entire control. ; 

[0275] Specifically, according to the embodiment, in the communication unit 301 , when the data including not only 
the image data but also audio data, and the (ike are received, the conflict resulting from the case where two operations, 
data receiving operation and photographing operation, occur with respect to memory resource is avoided. 
[0276] For this purpose, instead of the program of Fig. 1.5, a program according to a flowchart, for example, shown 

15 in Rig.. 18 is used. 

[0277] Additionally, in the flowchart of Fig. 18, the processing steps similar to those of the flowchart of. Fig. 15 are 
denoted with the same reference numerals, and the detailed description thereof is omitted. ... 

[0278] First,. it is judged whether or not the communication unit 301 is in the reception called state (step S631 ), and 
it is then judged whether or not the image input unit 305 is in the photographing state (step S632) When these judgments 
20 resull in the reception called state and the photographing slate, the subsequent processing steps are executed; oth- 
erwise the present processing is ended. 

[0279] When the units are in the reception called state and the photographing state, the control unit 308 judges 
whether or not audio communication or audio data reception (hereinafter referred to as the audio data communication) 
is starting in the communication unit 30,1 (step S661). «• ■ \ . 

25 [0280] As a result of the judgment .of the step S6S1 , when the audio data communication is performed, the operation 
is compatible : with the photographing operation, Therefore, the, reception processing for the audio data communication, 
i photographing processing? compression processing, and, recording processing are continuously performed (step 
S638). Thereafter, the present processing is ended. ■ . . . , 

[0281] Additionally, in this case, for example, the message for informing the above-described operation is displayed 
30 on the color liquid crystal display 1 07 (electronic view finder), so that the user may select whether to start conversation 
with the partner. Moreover, when the audio'data such as voice mail is received, regeneration may be started. 
[0282] Therefore, as the judgment result of the step S661 , when the audio data communication is not to be performed, 
the processing by the above -described steps S633 to S637 is executed to avoid the conflict in the case where two 
operations of the data receiving operation and photographing operation occur with respect to the memory resource. 
35 [0283] Additionally, in the fourth embodiment, when the communication unit 301- receives the data including both the 
audio data and the image data, for example, Jhe cprnmunication of only the audio. data is first performed, and a request 
for resending of the image data is then issued to the partner. Thereby, after the audio data communication; the image 
data communication is performed: 5 . • . .. ... 

(Fifth Embodiment) '-" - • " * ■ ".' "■ 1 - ; 

[0284] A fifth embodiment will be described with reference to Fig. 19. In the first to fourth embodiments, when it is 
judged that if the data to be received is received, the capacity for storing the generated data does not remain in the 
recording medium, the data to be received js transferred to another device. Jn. the fifth embodiment, however, the data 
already stored in the recording medium is transmitted,' a vacant capacity for the transmitted data is secured in the 
recording medium, before the reception is performed. 

[0285] In Fig. 19, the digital camera 100 is provided with a cbmrriuh teat ion unit 1301 , a received amount calculating 
unit 1302 and a data storage unit 1 303 to which outputs of communication unit 1301 are supplied, a memory 1 304 to 
which an output of data-storage-unit 1303 is supplied, an image input unit 1305, an image compressing unit 1306 to 
which an output of image input unit 1305 is supplied, and an image storage unit 1307 to which an output of image 
compressing unit 1306 is supplied. An output of image storage unit 1307 is also supplied to the memory 1304. 
[0286] The digitarcamera 100 is, also provided with a memory remaining amount "calculating unit 1309 to which an 
output of memory 1304 is supplied; an. input unit 1310; a photographing mode setting unit 1311 to which an output of 
input unit 1310 is supplied; and a photographing image amount control unit 1308 to which outputs of the above-de- 
scribed received amount calculating unit 1302, memory remaining amount calculating unit 1309 and photographing 
mode setting unit 1311 are supplied, and an output of photographing image amount control unit 1308 is supplied to 
the image compressing unit 1306. 

[0287] * Here, first the. communication unit 1301 corresponds to the PHS unit 203. 
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[0288] The received amount calculating unit 1 302 is realized by the software whieh'is executed in the CPU 29 of the 
main CPU unit 201 . The received amount calculating unit 1 302 uses the communication protocol to calculate the data 
amount of data estimated to be received by the communication unit 1301 (estimated amount of received data). 1 
[0289] The data storage unit 1303 stores the data received by the communication unit'1301'into the memory 1304 

5 using the file system. - ' v - ■ - - 

[0290] The memory 1304 corresponds to the flash ROM 32 (nonvolatile memory) of the main CPU 201 . 
[0291] The image input unit 1 305 corresponds to the entire camera unit 204 which has the constitution shown in Fig. 6. 
[0292] The image compressing unit 1306 is incorporated in the CPU 29, and is constituted so that the compressed 
image data size can be adjusted by changing the quantization table. 

10 [0293] The image storage unit 1307 stores the image data compressed by the image compressing unit 1306 into 
the memory 1 304 by the CPU 29. : .> 

[0294] The photographing image amount control unit 1 308 is realized by the software of the CPU 29.-. 
[0295] Specifically, by changing parameters such as the quantization table in the image compressing unit 1306, the 
compressing control is performed. That is, when it is judged by the indication from the memory remaining amount 

is calculating unit 1309 that the remaining amount of the memory 1304 is small, the judgment is notified to the image 
compressing unit 1306 to change tile compressibility in the image compressing unit 1306. Moreover, control is per- 
formed so that arbitrary image data is selected from the image data already stored in the memory 1 304 and transmitted 
to the external apparatus. Thereafter, the transmitted image data is erased from the memory 1 304. 
[0296] The memory remaining amount calculating unit 1 309 is reatiz^d by the r soflware of the CPU 29, and uses the 

20 table ol the file system constructed on the memory 1 304 during the calculation of the remaining amount of the memory 
1304. 1 ' r * 

• • [0297] The input unit 1 310 corresponds to input switches such as the mode dial 1 01 . Specifically, the unit is Lsed in 
the case where the photographer indicates the photographing mode and in other cases. 

[0298] The photographing mode setting unit 1311 sets the photographing mode by notifying the state of the mode 
25 dial 101 (input unit 1 31 0) to the CPU 29 by 'the sub CPU 1 of the sub CPU unit'202, • > : ! ' * 

[0299]' Here,-Table*2^shows; examples of photog raphing- modes for -chan gin the' image> compressing unit 1306 by 
* the= photographing image amount control unit 1308, and memory sizes necessary-fdr recording the image obtained by 
the photographing modes into the memory 1 304. ' ■* : ~ -•■ f " •'-*'*»' ' > ••' 

30 y . . :Table.2 .\* 



35 



Recording Image Mode 


Necessary Memory Size per Sheet 


. Economy 


25 KB . 0F . ^ - 


Normal : 


*50KB- - ' 


Fine 


. -.100.KB ... .... . rw . 



[0300] As shown in Table 2, here, the photographing mode is set to three stages: ECONOMY mode; NORMAL mode; 
and FINE mode, and the memory size necessary for recording one sheet of image is set to 25 KB, 50 KB, and 100 KB, 
[0301] Moreover, when the image data is stored in the memory 1304, for example, a storage management table as 
shown in Table 3 is prepared. The storage management table is prepared in an inner memory or the memory 1304 by 
the photographing image amount control unit 1308. .-. . ■ 

table 3 " . ' V.' ... 



45 


Name 


size 


Record 
Date/Time 


Access - . 
Dale/Time 


Access 
Frequency - 


:Mark 


Used Color 
No: 


Storage Place 




MX0001 ".jpg 


25KB 


1996/12/25 
PM3:00 : ' 


1997/1/7 
PM 10:00 


3 . 


x . 


32768 


100 


50 


MX0002 .jpg 


50KB 


1996/1 2/31 - 
AM9:45 


1996/1 2/31 
AM9:45 


1 


o . 


. 65536 


.125 




MX0003 .jpg 


100KB 


1997/1/3 
PM2:10/ 


k 1997/1/5 
AM3:00 




x - 

• i *' 


37 !: * ' 


175 


55 


MX0004 jpg 


50KB 


1997/1/7 
AM.10:30 


1997/1/7 
AM9:30 . 


. 7 


X 


, 65536 y 


.275 



[0302] As shown in Table 3, the storage management table comprises information such as image size, recording 
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time, access date and time, access frequency, marking information, used color number, and storage place. Here, the 
storage management table is shown in the case where the image data of four sheets MX0001 . jpg to MX0004.jpg (image 
data compressed by' JPEG system) are stored in. the memory, r. ... 

[0303] Additionally the marking information is inputted by operating the input unit 1310 (switches, and the like) by 
s the photographer. Specifically when the photographing is performed, the photographer grasps to some degrees wheth- 
er or not the photographed image is important. Therefore, when the photographer judges that the photographed image 
is important, the input unit 1310 is used to input the marking information (-provided with the priority with respect to the 
photographed image). The inputted marking information is recorded as the marking information of the photographed 
image data into the storage management table. Therefore, by referring to the marking information of the storage. man- 
ia agement table, it can be judged whether or not the image data is important. 

[0304] A processing by. the software for implementing the most characteristic operation in the digital camera 100 will 
be described hereinafter. 

[0305] A program according to a flowchart, for example, shown in Fig. 20 is stored beforehand in the ROM 32 of the 
main CPU unit 201 , and the program is read and executed by the CPU 29, so that the digital camera 100 operates as 
is follows. : . 

[0306] First, it is judged whether or not.the communication unit 301 (PHS unit 203) is in the reception called state 
(step S6310), and it is also judged whether or not the image input unit 1 305 (camera unit 204) is in the photographing 
state (step S6320). 

[0307] When these judgments result in the reception called state and the photographing state, the subsequent 
20 processing steps-are executed; otherwise the present processing is ended. 

[0308] Additionally, the judgment of the step S6320 concerning whether or not the unit is in the photographing state 
is performed by detecting whether the shutter button 102 is half or completely depressed. Alternatively, it is detected 
whether CAMERA mode is set by the mode dial 101 . 

[0309] When the units are in the reception called state and the photographing state, the photographing image amount 
25 control unit 1308 obtains value A by subtracting the estimated amount of the received data calculated by the received 
amount calculating unit 1 302 from tha remaining amount of the memory 1304. calculated by the memory remaining 
amount calculating unit 1309;( step 56330) * t , - ... . ; 

[0310] Here, for the estimated amount of the received data,for example, the estimated amount of data obtained by 
receiving E-mail is calculated. Specifically, the above-described POP 3 is used as the communication protocol, and 
30 LIST and STAT commands of POP 3 are used in the step S6T5 of requiring the information of plural types for the server 
in the program as shown in. Fig. 13 to calculate the amount. 

[0311] Subsequently, the photographing image amount control unit 1 308 obtains the typical compressed image size 
for the present photographing mode set by the photographing mode setting unit 1311 from the Table 2, and subtracts 
the- obtained image size from the value A obtained in the step S6330. Then, it is judged whether or not the result 

35 exceeds the value of the predetermined amount (step S6340). 

[031 2] Here, the reason why the value of the predetermined amount is used as the offset is that it is difficult to predict 
the compressed image size in the compression of JPEG system or the like and that only the typical size of the com- 
pressed image can be predicted. By setting the value of the predetermined amount to be large, it is possible to secure 
the predetermined amount of sheets of photographed image even after the communication ends. - s , 

40 [0313] As a result of the judgment of the step'S6340, when the subtracted value exceeds the value of the predeter- 
mined amount, this indicates that there is an allowance in the remaining amount of the memory 1304. Therefore, the 
reception processing, photographing processing, compression processing, and recording processing are continuously 
performed (step S6380), thereby ending the present processing. 

[0314] As a result of the judgment of the step S6340, when the; subtracted value does not exceed the value of the 
45 predetermined amount, the photographing image amount control unit 1308 selects image data to be sent to another 
apparatus Irom the image data stored in the memory 1304 as detailed later in order to increase the remaining amount 
: of the memory 1304 (step S6350): \ . ' 
[0315] Subsequently, the photographing image amount control unit 1308 controls the communication unit 1301 so 
that the image data selected in the step S6350 is read from the memory 1304 and sent to another apparatus (step 
so S6360). . t - . 

- [0316] Additionally, the transmission destination herein may be a partner called in the step S631 0, or.a specific server 
"designated beforehand. For example, when the data is sent to the specific server designated beforehand, and the 
server is not the partner called in the step S631 0, the communication with the called partner is temporarily disconnected, 
and communication: is performed with the server to which the data is to be sent. When the communication is finished, 
S5 the called partner is connected to perform communication.. - 

[0317] After the processing of the step S6360, thephotographing image amount control unit 1308 erases the image 
data sent by the communication unit 1301 from the memory 1304 (step S6370). Therefore, the remaining amount of 
the memory 1 304 increases. . .. 
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[0318] Thereafter, the processing returns to the step S6340, and the. subsequent processing steps are repeatedly 
performed. • " •' • t ~' •= : • '■ . • . n*. vi, ; 

[0319] Fig. 21 is a flowchart showing one example of an image selection .processing in the above-described step 
S6350. • ■' " " 

5 [0320] First, in the storage management tabte shown in Table 3, the image data shown by the top management 
information is selected as tentative image data to be sent (step S6410). 

[0321] Subsequently, the management information next to the management information for the image data selected 
in the step S6410 is loaded (step S6420). 

[0322] Then, it is judged whether or not the management information can normally be loaded in the step S6420 (step 
io S6430). ■*-!.-£ •■ i 

[0323] As a judgment result of the. step S6430,.when the information cannot be loaded, the image data tentatively 
selected in the step S6420 is oldest, and following the image data, no image data exists. Therefore, the image data 
tentatively selected in the step S6420 is determined as the image data to be sent. Subsequently, the processing returns 
to the processing of the flowchart of Fig. 20. - 
is [0324] As the judgment result of the step S6430, when the information can normally be loaded, it is judged whether 
or not the image data shown by the loaded management information is older than : the image data tentatively selected 
in the step S6420 (step S6440). The' judgment is performed using the recording date and time. (preparing date and 
time) included in the management information. 

[0325] As a judgment result of the step S6440, when the image data is older than the tentative image data, the image 
20 data shown by the management information loaded in the step S6420 is. regarded- as. the tentative image data to be 
. transmitted. Thereafter, the processing returns to the step S6420, in which the next management information is loaded. 
[0326] As the judgment result of the step S6440, when the image data is not older than the.tentative image data, the 
processing returns to the step S6420 as it is, in which the next management information is loaded. 
[0327] Additionally, in the above r described image selection. processing;; in the step 86440;* the data having . the older 
25 proparingdatc and time.is preferential ^selected as the image data to beftransmitted, but the processing is not limited 

to this. Examples of the reference' fdr selecting thre image. jdatafito be .transmitted are;as follows: . ..... :: . 

[0328] (Example 1): As shown in Fig. 22, by step S6510 provided instead ohthe'step S6440,i the data having less 
access frequencies (less purposes) is preferentially-selected as/t he image.data-to be -transmitted. 1 In the judgment, the ^ 
access frequency included in the management information is used. \ . - « . . ^ 

30 [0329] (Example 2): The image data having less number of used colors, is preferentially selected as the image data ^ 
to be transmitted. This is because there is a high possibility .that data having less number.ofccolors is sometimes failure 
image.data such as^strpbe issuance mistake. In thiscase.the^numberof used colors. included in the management 
information is. used inthe judgment. . / ■* . - v ?^ 

[0330] (Example 3). .The unimportant image data is preferentially selected as the.image data to be transmitted by ^ 
35 the marking information inputted by the photographer. \„ - . f . ,v . . .. ^ ■ 

S ■■• •;: p -^i :• • • : : :» ■■ ■• s ' •» - 

(Sixth Embodiment) ..<•-:. v-- v k • • ;. :. 1 . „*:i-. . • ■. r . ^ - 

[0331] The digital camera iia a sixth embodrmenKhas a. constitution 9imilar:,to that of: the digital camera 100 in the 

40 .fifth embodiment (see Fig. 49), but is different in the entire control.]. *»» or.. .:: <K •;- : 

[0332] Specifically; in the embodiment,- the~:commmicato^ 301 and the photo- 

graphing operation in the image inputs unit 305 are overlapped. Therefore;; when a shortage- of. the remaining amount 
of the memory 1304 occurs, the image data selected;by. executing the image selection processing (sending image 
selecting function) as shown. in Figj21 t(or Figj22)us-trarismitted after, ithephotographing operation. 

45 [0333] Specifically, in order, to value; a response as the camera for the.huser, first the photographing operation is 
performed. Then, for the timing to record the :4mage obtained by the. photographing operation into the memory 1304 
by the image storage unit 1 307, the recording is performed after the image data selected by the image selection process- 
ing is transmitted. Since the- image. storage* unit 1307 is realized by the CPU!29, EDODRAM 30, and software control 
(see Fig. 5), the image data obtained by the photographing operation is stored in the EDQDRAM 30,. until the.trans- 

50 mission of the selected image data is completed. 

[0334] . For this purpose,: instead of. the program of Fig..20, for example, a program according to a flowchart.shown 
in Fig. 23 is used. By executing the program, . the conflict in'the case where two operations of the data receiving operation 
and photographing operation occur with respect : to:the; memory resource-can be avoided. / - . 
[0335] Additionally, in the flowchart of Fig: 23, the steps performing the processings similar to those in the flowchart 

55 of Fig. 20 are denoted with the same reference numerals, and the detailed description thereof is omitted. . 

[0336] -First, it is judged whether or not the communication unit 1301 is in the reception called state (step t S63l0), 
and it is then judged whether or not the image input unit 1 305 is in the photographing state (step S6320). When these 
judgments result in the reception called state and the photographing state, the subsequent processing steps are exe- 
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cuted; otherwise the present processing is ended. 

[0337] When the units are in the reception called state and the photographing state, the photographing image amount 
control unit 1308 obtains the value A by subtracting the estimated amount of the received data from the remaining 
amount of the memory 1304 (step l S6330); then the typical size of the compressed image for the present photographing 
5 mode is subtracted from the value A, and it is judged whether or not the result exceeds the value of the predetermined 
amount (step S6340). 

[0336] Furthermore, as a result of the judgment of the step S6340, when the subtracted value exceeds the value of 
the predetermined amount, this indicates that there is an allowance in the remaining amount of the memory 1304. 
Therefore, the reception processing, photographing processing, compression processing, and recording processing 

10 are continuously performed, thereafter ending the present processing. ■ - 

[0339] On the other hand, as the judgment result of the step S6340, when the subtracted value does not exceed the 
value of the predetermined amount, in order to increase the remaining amount of the memory 1 304, the photographing 
image amount control unit 1 308 first selects the image data to be sent to another apparatus from the image data stored 
in the memory 1 304 according to the flowcharts shown in Fig. 21 or 22 (step S6350). 

15 [0340] Subsequently, the receiving processing, photographing processing, compression processing, and recording 
processing are performed (step S6380). In this case, the photographing image amount control unit 1308 controls the 
image recording unit 1307 so as to record the image data obtained by the photographing operation once in the EDO- 
DRAM 30. 

[0341] Subsequently, the photographing image amount control unit 1 308 controls the communication unit 1301 so 
20 that the image data selected in the step S6350 is read from the memory 1304 and sent to another apparatus (step 
S6360).- r 

[0342] Next, the photographing image amount control unit 1308 erases the image data sent by the communication 
unit 1301 from the memory 1304 (step S6370). Therefore, the remaining amount of the memory 1304 increases. 
[0343] Thereafter, the photographing image amount control unit 1 308 controls the image-recording unit A 307 so as 
2S to record the image data once stored in the EDODR AM 30 (volatile memory) into the memory 1 304 (nonvolatile memory) 
(step S63'90). Thereafter, the present processing is ended. . • . ; 

[0344] Therefore, ihthis case/ after the image data is sent to another. apparatus, the image data obtained by the 
photographing operation is written into the memory 1304. 

30 (Seventh Embodiment) 5 - v ...->-,-;. 

[0345] The digital camera in a seventh embodiment has a constitution similar to that of the digital camera. 100 in the 
fifth embodiment (see Fig. 19), but is different in the entire control. 

[0346] Specifically, in the embodiment, only when the reception from the specific partner is performed in the com- 
35 muhication unit 1 301; the : irriage data selected by executing the image selection processing (sending image selecting 
function) as shown in Fig. 21 (or Fig. 22) is sent after the photographing operation. 

[0347] For this purpose, instead of the program of Fig. 20, a program according to a flowchart, for example, shown 

in Fig. 24 is used. > • ■ 

[0348] Additionally, in the flowchart of Fig. 24, the processing steps similar to those of the flowchart of Fig. 20 are 

40 ' denoted with the same reference numerals, and the detailed description thereof is omitted. 

[0349] First, it is judged whether or not the communication unit 1301 is in the reception called state (step S6310), 
and it is then judged whether or not the image input unit 1305 is in the photographing state (step S6320). When these 
judgments result in the reception called state and the photographing state, the subsequent processing steps are exe- 
cuted; otherwise the present processing is ended. 

45 [0350] When the units are in the reception called state and the photographing state, the photographing image amount 
control unit 1308 obtains the value A by subtracting the estimated amount of the received data from the. remaining 
1 amount of the memory 1304 (step S6330).' Thereafter, the typical size of the compressed image for the present pho- 
tographing mode is subtracted from the value A, and it is judged whether or not the result exceeds the value of the 
"-' predetermined amount (step S6340). ' • 

50 [0351] As a result of the judgment of the step S6340, when the subtracted value exceeds the value of the predeter- 
mined amount, this indicates that there is an allowance in the remaining amount of the memory. 1304. Therefore, the 
reception processing, photographing processing, compression processing, and recording processing are continuously 
: performed (step S6380), thereby ending the ( present- processing. 
[0352] On the other hand, as the judgment result of the step S6340,'when the subtracted value does not exceed the 

55 ' value of the predetermined amount, the photographing image amount control unit 1308 judges whether or hot the 
image data is received f rom the specific partner in the communication unit 1 301 (step S641 0). The judgment is realized, 
!> for example, by using the transrhissibn number obtained from transmission number service, grasping the transmission 
number of the partner, and comparing the number with the transmission number preset by the user (number of the 
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specific partner). r . 1 - • i- . ' ... 

[0353] As the judgment result of the step S6410; when the-specific partner is. not judgedrthe.photographing image 
amount control unit 1 303 controls the communication unit 1 303 to stop the receiving operation. Thereby, the receiving 
operation is not performed in the communication unit 1301: On the other hand, the- photographing processing, com- 
5 pression processing, and recording processing are continuously performed (step. S6420). Thereafter, the present 
processing is ended. 

[0354] As the judgment result of the step S6410,. when the specific partner is judged, the photographing image 
amount control unit 1 308 selects the image data to be transmitted to another apparatus from the image data stored in 
the memory 1304 according to the flowchart shown in Fig. 20 or 21 (step S6350). . 
10 [0355] Subsequently, the photographing image amount. control unit 1308 controls the communication unit 1301 to 
read the image data selected in the. step S6350 from the memory 1304 and send the data to another apparatus (step 
S6360), and erases the^image data from the memory -1304 (step S6370). Therefore, the remaining amount of the 
memory 1 304 increases.. . -. * . <.- : * ■ ■ 

[0356] Thereafter, the processing returns to the step S6340, and the* subsequent processing steps are repeatedly 
15 performed. 

(Eighth Embodiment) , . • . - » ; \ r . 

[0357] The digital camera in an eighth- embodiment has a constitution similar to that of the digital camera 100 in the 

20 fifth embodiment (see Fig. :1 9), but is different in the entire control. •„ - 

[0358] Specifically, in the embodiment, even when the data including not only the image data but also audio data 
are received in the communication unit 1 301 , thaconflict resulting from the ; case where two operations, da*a receiving 
operation and photographing operation, occur with respect, to the memory resource is avoided. 
. * [0359] For this purpose; instead of the program of Fig. 20, a program according to a flowchart, for example; shown 

25 . in Fig. 25 is used. . . , .. ■ ; ♦ • *v . : ■** ■. I o v.- • . > • 

[0360] Additionally, in the flowchart of Fig. 25, the pro.(^ssing:ste^S:simi]ar:,|p4liose of the flowchart of Fig . 20 are 
denoted with the same reference numerals, and the Retailed descriptionjtherepf is ;l omitteck 5 r , . , , { - - 
[0361] First, it is judged whether or not the communication unit/1 301, ,is. : in the -reception called state, (step SS310), 
and it is then judged whether or not the image input unit 1 305 is in the photographing state (step S6320). When these 

30 judgments result in the reception called state and the photographing state, the subsequent processing steps are exe- 
cuted; otherwise the present processing is ended. 

[0362]' When the units are in the reception called state and the, photographing state, the photographing image amount 
control unit 1 308 judges whether or not audio communication- or aucjio data reception .(hereinafter referred to as the 
audio data communication) is p e rformed. ur th excommunication, unrt : 1i30V(step^S.655Q).j, , v ■> .'.i . 

35 [0363] As a result of the judgment of . the step S6^ 

is compatible with the photographing operation. Therefore, the reception processing for the audio data. communicati on, 
photographing processing, compression processing, :and recording -processing, are continuously - performed (step 
S6360). Thereafter, the present processing is ended. : , •• - ■ 

[0364] Additionally, in.this case, for example, rthe. message. for irvlpriming.theiabove-described operation is-displayed 

40 on the color liquid crystal:display 107* (electronic view-finder), so that the useomay select whether to start conversation 
with the partner Moreover, .when the audio ;data such as voice mail is received,; the regeneration may be started. 
[0365] Therefore, as the judgment: result of the. step S6510,. when .the. audio data communication is not performed, 
the processing by the above-described steps S6330.to S6370 is executed to avoid the. conflict in.the case where two 
operations of the data receiving operation and photographing operation occur with respect to the memory resource. 

45 [0366] Additionally, in the eighth embodiment, when the communication* uniM 301 receives the data including both 
the audio data and the image data, for example, the communication only of the audio data is first performed, and 
subsequently the request for resending the image data is issued to the partner Thereby, after the communication of 
the audio data, the communication of the image data is performed... .. ■ . ♦ .-. 

[0367] Moreover, needless to say the object of the present invention is also attained by; providing the system or the 

so device with the storage medium in which the program code of the*software for. realizing the-f unctions of the host com- 
puter and terminals according tothe above-described embodiments is stored; and by reading and executing the pro- 
gram code stored in the, storage medium, by the system or the device computer (or CPU or MPU).. . 
[0368] In this case, the program code itself read from the storage. medium realizes the abpve^described functions of 
the embodiments,- and the storage medium in which the program code is stored constitutes the present invention. 

55 [0369] . As the storage medium for supplying the program- code, ROM,- floppy disk, hard disk, optical disk, optomag- 
netic disk, CD-ROM : CD-R, magnetic tape, nonvolatile memory card, and. the like can be used. 
[0370] Moreover, by executing the program code read by the computer, the. above-described function of each em- 
bodiment is realized, but needless to say, there is also included the constitution which comprises performing a part or 
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the whole of an actual processing by OS or the like operating on the computer based on the^ instruction of the program 
code to realise the function. of each embodiment by the processing. _ •> . 

[0371] Furthermore, needless to: say, there is also included the constitution which comprises writing the program 
^ code read from the storage medium into a memory disposed on a function expansion board inserted into the computer 

5 or a function expansion unit connected to the computer based on the instruction of the program code, and performing 
a part or the whole of the actual processing by a CPU or the like disposed on the function expansion board or the 
function expansion unit, so that the function of each embodiment is realized by the processing. Additionally, in the 
above description, the case using the POP 3 has been described, but of course, the present invention is not limited to 
the case. Any program can be utilized in the present invention as long as the size of the received data in the process 

10 of communication is seen. 

[0372] As described above, according to the present invention, the problem that the generated data cannot be re- 
corded due to the transmitted data can be prevented. Particularly, when the present invention is applied to the digital 
camera or the like, the problem that the photographed data cannot berecorded because of the transmitted data can 
be solved. ' ■ , : ' , . . 

is [0373] If the transmitted data is transferred, it can be confirmed later, but considering that the scene to be photo- 
graphed is momentary and could not be seen twice, it is significant to constantly provide an allowance to record the 
photographed image. 

[0374] Moreover, in the constitution, it is possible to retain the image data (second data) obtained by photographing 
as intended by the user, and it is unnecessary to erase the image data previously photographed and stored in the 
20 memory to secure the memory remaining amount. Moreover, since the transmission instruction itself can momentarily 
be given, the instantaneous property of photographing is not lost. 

[0375] Furthermore, in the above-described case, the data to be received is transmitted, and additionally only a part 
of the data to be received (third data such as information to hold the outline of the data to be received) is received. 
Alternatively, while the data to be received is transmitted, the information concerning the data to be received (information 
25 such as data size and transmission destination) is retained - • . , . 

[0376] * In the constitution; the instantaneous property of the data to be received can be kept, 

[0377] Moreover, when the reception is performed from the predetermined specific communication partner, by per- 
forming the transmission of the data to be received, the priority of photographing and communication can be controlled 
by the communication partner. Therefore, only the communication from the specific partner can be received in prefer- 

30 ence to the photographing. ' . ■ . 

[0378] Furthermore, when the received data is other than the audio data, by performing the transmission of the data 
to be received, talking or the like and photographing are compatible during the reception of the audio data. 
[0379] Additionally, as described above; according to the present invention, the non-storage amount of the memory 
(storage means) in which the second data (image data obtained by photographing, and the like) and the first data 

35 (received data) are stored is managed. When the non-storage amount is equal to or less than the predetermined 
amount, the data already stored in the memory is transmitted to the outside. This is effective when the received data 
is to be confirmed as quickly as possible, because different from the first to fourth embodiments, the transmitted data 
is preferentially taken. 

[0380] Specifically, for example, the total data-size is obtained by adding the received data (first data) to the estimated 
40 size of the photographed image data (second data) obtained by the photographing operation in the designated pho- 
tographing mode, and the total data size is compared with the non-storage amount (remaining amount) of the memory. 
As a result of <the comparison, when the total data size is larger than the remaining amount of the memory, the infor- 
mation concerning the data already stored in the memory (recording time information, access frequency information, 
marking information added from the outside, and the like) is used to select the oldest information, the information having 
less access frequency, orHhe information to which no marking information is added from the user from the data already 
stored in the memory, and the selected data is transmitted to another apparatus, and the like. 
[0381] In the constitution, the photographed image data can be retained as intended by the user, and no photo- 
graphed image data is lost. Moreover, when the data to be transmitted is selected, by using the above-described 
" marking information, the data provided with the priority by the user is prevented from being transmitted. 
so [0382] Moreover, when the data transmission is constituted to be performed before-the photographing of new image, 
the memory amount necessary is secured at the time of actual photographing. Therefore, the photographed image 
data as well as the received data can securely be stored in the memory. 
<• [0383] Furthermore, when the data transmission is constituted to be performed after the photographing of new image, 
the user can perform photographing without missing the photographing timing. In this case ; for example, the photo- 
ns graphed image data is once stored in the volatile memory such as DRAM. After the data transmission, the stored 
photographed image data is stored in the nonvolatile memory. 

[0384] Additionally, the data transmission is constituted to be performed while data is received from the specific 
partner. In the constitution, since the priority of the communication partner can be given, the failure in the communication 
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from the specific partner can be prevented. . -i.-- \ * 1 * ; ■• >*.v - • . t w • 

[0385] Moreover, the data transmission is constituted to be performed only when the- data other than the audio data 

is received. Then, talking or the like andphotographing.operations are compatible. 

[0386] As described above, according to the present invention; in the devices the !ike in .which the digital camera 
5 and the communication apparatus areunteg rally formed, the demerit of .the collision of the memory resource can be 
solved. In this case, by utilizing the marking information from the user asmears for selecting the data to be transmitted, 
rational judgment can be performed. Moreover, the requirements. of both the highly reliable communication and the 
highly instantaneous photographing operation can be satisfied, and the compact and handy device or system can be 
constituted. Furthermore, even in the- photographing place, quick photographing and communication reliability can be 
10 secured without missing any shutter chance. 

[0387] Additionally, in the present invention, since the control is constituted to be realized by controlling the CPU, 
the memory, and the like, the constitution can easily be realized even in. the usual transmission device, the digital 
camera provided with the transmission device interface, and the like. Therefore, in the present invention, the digital 
camera, and the like can be reduced in size, power consumption and cost, and the present invention can be said to 
is be significant also in future. *• 

[0388] Moreover, in the present invention,. even when there is no sufficient capacity to record the transmitted data 
in the memory, all the transmitted data can be obtained without compressing the data or discarding a part of the data. 

20 Claims - _ _ • * 

1. An information processing apparatus comprising: .... . • - 

reception means which receives data; ■ - . , 

25 generation means which generates data; and:,; * -r :ti \ • : 

control means: which controls recording of first d^ta^ received .by^said reception means and, second, data gen- 
. e rated-by said generation means into a storage -medium,- : . i i f^-iiq&Ci*: ^rrkv k> % a 

characterized in that said control means controls, recording of said first data into said storage. medium so 
30 that said second data may be stored in an unrecorded storage region of said storage medium when said first data 

- is received. ■ h- < . v* •.: «. > « ■ »c ^. - * '* . j>o ? -....m . : •; 

2. An apparatus according .to. claims, wherein said^contrpl means includes transmission means which sends to an 
transmission side apparatus an instruction that sard firsi.data is transferredto.anothen.apparatus when a difference 

35 hetween an unrecorded storage capacity, of said storage»medium and an amount of said first data is less than a 

predeterm in ed valuev * =>:--., v. ! /*; "T.^m ~ Us «:. * 

3. An apparatus according to claim 2, wherein said generation means includes image pickup meansand generates 
image data picked up by said image pickup imeans as^aid second data - • & : 4 

.4. An apparatus according to claim 3,!wherein:satd image:pickup means«has:a plurality of modes each relating to a 
data size of an image to -be photographed; and.wherejn said, p redeterm in ed,valueJs determined to such a value 
as to be larger than at feast a data. amount of an imager • i> u ■. ? ?.r^ J - 

45 5. An apparatus according to claim 2, wherein when sending an.Jnst ruction of said transfer, said control means stores 
a part of information relating to said first data. into said storage medium. 

6. An apparatus-according lo claim 1 , .wherein said control means includesjransmission means which sends to an- 
other apparatus data which corresponds to at least an amount of said first data from data stored in storage : medium 

50 . when a difference between an unrecorded storage.capacity of said storage medium and arramount of saicj first 

data is less than a predetermined value. ■, . ;;. .-»...- ' - :. . '■»-•- 

7. . An apparatus according to claim 6, .wherein said generation means includes image pickup means and generates 
, .image data picked up by said.image. pickup means, as said second data- - ... 
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An apparatus according to claim 7, wherein . • r r ; * i,.. t. . 

said image pickup means has a plurality of modes each relating to a definition of an image to be photographed; 
•and wherein said control.means includes. processing means which processes a predetermined value in such a 
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way that said predetermined value may be larger than at least a data amount of an image according to said mode. 

9. An apparatus according to claim 6, further comprising selection means which selects data to be sent, wherein said 
selection means is used to send data selected by a user 

10. An apparatus according to claim 1 , wherein said generation means includes acceptance means which accepts an 
instruction for data generation according to a user's manual. 

11: An information processing method comprising the steps of: 

receiving data; 
generating data; and . 

controlling recording of first data received by said reception step and second data generated by said generation 
step into storage medium, 

characterized in that said controlling step controls recording of said first data into said storage medium in 
such a way that said second data may be stored in an unrecorded storage region of said storage medium when 
said first data is received. 

20 12. A method according to claim 11, wherein said controlling step comprises a transmission step which sends to a 
transmission side apparatus an instruction that said first data is be transferred to another apparatus when a dif- 
ference between an amount of an unrecorded storage capacity of said storage medium and an amount of said 
first data is less than a predetermined value. 

25 13. A method according to claim 12, wherein said generation step comprises an image pickup step and generates 
image data imaged by said image pickup step, as said second data. 

14. A method according to claim 1 3, wherein 

30 said image pickup step has a plurality of modes each relating to a data size of an image to be photographed; and 

said predetermined value is determined to such a value as to be larger than at least a data amount of an image. 

1 5. A method according to claim 1 2, wherein said controlling step stores a part of information relating to said first data 
into said storage medium when said instruction of transferring is sent. 
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16. A method according to claim 11 , wherein said controlling step comprises a transmission step which sends to another 
apparatus an amount of data which corresponds to an amount of at least said first data from data stored in storage 
medium when a difference between an amount of unrecorded storage capacity of said storage medium and an 
amount of said first data is less than a predetermined value. 

17. A method according to claim 16, wherein said generating step comprises an image pickup step and generates 
image data picked up by said image pickup step, as said second data. 

18. A method according to claim 17, wherein 



said image pickup step has a plurality of modes each relating to a definition of an image to be photographed; 
and 

wherein said controlling step comprises a processing step which processes a predetermined value in such a 
way that said predetermined value may be larger than at least a data amount of an image according to said 
^0 mode. 

19. A method according to claim 16, further comprising the steps of: 

selecting data to be sent; and 
55 sending data selected by said selection step. 

20. A method according to claim 16, wherein said generation step comprises a step of accepting an instruction for 
data generation according to a user's manual. 
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21 . A storage medium which stores a program comprising the steps of .-. v..-.,'.. 1 - ■ 

receiving data; : - " • ■ > - 

generating data; and ».» *■ ; . * 

controlling recording of first data received by said reception step and second data generated by said generation 
step into a storage medium, • - -. 

characterized in that said controlling step controls recording of said first data into said storage medium ac- 
cording to a data amount of said first data in such way that said second data may be stored in a remaining storage 
region of said storage medium when said first data is received. 

22. An image pickup apparatus, comprising said information processing apparatus according to claim 1 . 

23. A communication apparatus, comprising said information processing apparatus according to claim 1 . 



20 



25 ., 



30 



35 



40 



45 



ri - . E ' 



SO 



55 



BNSDOCID: <EP 0991 260 A2 i > 



27 




BNSDOCID: <EP 0991260A2_I_> 



28 



BNSDOCID: <EP 0991 260 A2_L> 



EP 0 991 260 A2 




30 

BN.SDOCID: <EP 099 1 260A2_I_> 



EP 0 991 260 A2 



CD 





CD 


LO 


LO 


CD 


CD 


LL_ 


LL_ 



CO 





cc 






LU 

O 

ZD 

o 








CO 




LU 
LU 










Q— 






CO 



















o 



CO 
Q_ 



5 



o. 

CD. 
CO 



5 



CO 
CO 

CO 



CO 



O 

X 

CC 



X 



CVJ 



CO 



"cm 



cz> .„ 







T 


O 




o 

CVJ 


■RIA 


CD 


CL. 

CD 






CO 






O 











CCV 



uu 

1= 



CO CO 



II 



CM 

CO 



Q 

S co 



7 



1 



CD 
cc 



CO 
LU 

DC 

clT 



CO 



co 

CD 
C\J 



co 



CO 



CM' 
CM 



DC 
LU 

CO 



o co o 



C_>CDCJ> 

<c <a: lu 

<C O Q CO 



O 

O 
O 



CM 



CO 
CM 



CM ^ 



CD 

X 



cz> 

X 

cc 



CO 
CM 



Lu CD 
co 



CL. 



CL_ 

CD 



CD 



ID 
CL 

O 
■ i 
CQ 
ID 
CO 



CD 



O 

CL. 

CD 



O 

CU CL_ 

CD CD 



O 
Q_ 
CD 



CJ> 
CO 

<c 

<Ci 

CO. 

co 
OC 
CO 

o 



O 2^ 

CO T- 

-co "V 



CDI 

co: 



CM. 



7. CD 



CO 



CVT 



• LO 



CO 



LU 



CD 
CM 



CO 
O 



CM 
CD 
CM 



BNSDOCIO. <EP 0991260A2_I_> 



31 



BP 0 991 260 A2 



<M 
CO 



CO 



CO 

uu OC 



— V 



o 

CO 



CD 



LO 

o 



ar 

Q 
O 



CNJ 



< 



o 



CD 
CVJ N 



LU 

CO 



CO 



CO 



J 

X 



j 



CO 

CO 



CD 



CO 

CO v~ 



LO 

co 



IrDA 


LED 






IrDA 
MODULE 



CL 

o 



CO * 



J 


PARALLEL 


, MEMORY 


•SERIAL 
; PORT 2 




SERIAL 
PORT 1 


SERIAL 
PORTO 




GRAPHICS 




CPU 


DISPLAY . 



o 

CM 



OO 

CO - 



v 



0Q 

CD 



CM 



CO 

LU 

DC 



CM 



CD 
CM 



CO 



- o 




US' 



CZJ 



CO 








CM 

\ 




COLOR 
LCD 



Q 
O 



-co 



V 



CM 



6 



CO 



32 

BNSDOCID:<EP 0991260A2J_> 



EPC991 250A2 




CM 



cz> 

CM I 



. o 
o 
<c 

CO 

Q - 
O ~ 


CM i 

■JL 


— o 
1— 

- ~X- « 

L_ — » 


~i , 



."3.: 



CM 

CM; 

CM 



CO 
CM 




CO 
CM 



CM 
CM 



CCD 


- CO 
CM 
CM 


V-DRIVER 





cm 



BNSOOCID: <EP 099 1 260A2_I_> 



33 



U*. MP 0 991 260 A2 



k 3 IB- 



POWER ON 



S501 



STROBE CHARGE 



S 



S502 



CCD MODULE ENABLE 



EVF (LCD), START 



S504 



KEY OPERATION 
DETECTION 
; FROM UI 



-0 



FETCH -PHOTOGRAPHING IMAGE 
SIGNAL FROM CCD (320x240 DOT 
NO INTERLACE ANALOG SIGNAL) 



r 



S505 



IMAGE CORRECTION PROCESS 
BY IMAGE PROCESSOR (AWB, AE, 
FLASH, YCrCb (4:2:2) CONVERSION 
etc.) \ l — ... .. .. .„ u 



S506 



ASPECT RATIO CORRECTING 
PROCESS" 



S 



S507 



SIGNAL CONVERSION TO NTSC 
SIGNAL (NTSC ENCODER) 



S508 



OUTPUT NTSC SIGNAL TO 
LCD CONTROLLER. .... 



S 



IMAGE DISPLAY TO, EVF (LCD) 



j 



S509 



S510 



BNSDOCID: <EP 0991260A2_I_> 



34 



A EP 03991 260 A2 



FIG. 8A 



F/G. 8 



I 



FIG. 8A 



FIG. 8B 



READ KEY STATUS 



S521 



SHUTTER ON j S524 

YES^ 



-"S525 




LOCK CAMERA SETTING 
(AWB, AE, FLASH etc.) 



SEt-MObEJN HALF. 1 
DEPRESSING STATUS 



LOCK'/CAMERA • SETTING' 
(AWB/AE, FL^SH-etc:> ; 



'S530 



YES 



rSEL CAMERA MODE 
(AWBi AEr ELpH etc") 



j • — 



:!(S)tV.;S528 • 



EVF (LCD) FINISH 



CCD" MODULE DISABLE- 



■■<3 



I 



- PHGT06RAPHING - 
MODE END - 



-S532 
,-3533 
S534 



BNSDOCID: <EP Q991260A2 I > 



35 



CP 0 991 2S0A2 



F/<3. se 



READ KEY STATUS 



S535 



S536 




S53.7 



FETCH CAPTURE SIGNAL 
OF FULL IMAGE 

(640 x480 DOT) 

TO MEMORY (DRAM) 



JPEG COMPRESSION 
PROCESS- 



S540 



FILE COMPRESSED 
IMAGE DATA, AND WRITE 
IT TO FLASH MEMORY - 

I EVF (LCD)^ RESTART K ^. S541 - 



RE- DISPLAY FETCHED 
IMAGE FOR 

PREDETERMINED IMAGE 



S542 



S545 




RELEASE HALF 
DEPRESSION STATUS 
MODE 



S546 



(RETURN )-v^S543;; 



BNSDOCID: <EP 0991260A2J__> 



36 



fcu EFV0 991-2S0 A2 



F/G. 9 




AUDIO : 
ADDITION 
SELECTION 



ASPECT RATIO CORRECTING 
PROCESS FOR PROXIMATE 
IMAGE (DRAM) • - - 



SIGNAL .CONVERSION ;TQ~ 
NTSC SIGNAL : *"*' 
(NTSC ENCODER) ' 



~^S553:J r 



OUTPUT NTSC SIGNAL T_Q .-. - S554 • 

LCD CONTROLLER -^o-Tt-IA,-,. v-v. 



IMAGE DISPLAY TO 
EVF (LCD) r 



c 




3556- IMAGE 

DELETION 

PLAYBACK ^ SELECTION 

FUNCTION ? 



AUDIO ADDING 
PROCESS 



MAIL TRANSFER 
SELECTION- ~ ■ 



MAIL TRANSFER 
PROCESS 



3D 4 



S559 



IMAGE DELETING 
PROCESS 



37 



^ :EP G 991 260 A2 



FIG, 10 



POWER ON 



S571 



EVF (LCD) START 



S572 



READ DESIGNATED IMAGE (FILE) X s573 
FROM FLASH MEMORY 



. r - -JPEG DECOMPRESSING 
J PROCESS : •; • 



S574 



£ 

X S575 



WRITE IN MEMORY (DRAM) 



ASPECT RATIO CORRECTING 
PROCESS 



SIGNAL CONVERSION TO NTSC lr S577 
SIGNAL (NTSC ENCODER) 



OUTPUT NTSC SIGNAL TO |r S578 
LCD CONTROLLER - 



IMAGE DISPLAY TO EVF (LCD) 



S579 



38 



r- ER 0 991 200 A2 



FIG. 11 



( start: ,) 



TELEPHONE CONNECTION [yS581 
START 



S582 



TELEPHONE -. 
CONNECTION 
ESTABLISHED ? 



.YES • 



START PPP CONNECTION " y 



S583 



CONFIRM SETTING -S~Y v t3P 



1^S584 



S585 



USER- 

AUTHENTICATION 4S 
NECESSARY ? 



YES ^ v>3" 



USER AUTHENTICATION P 



ivS586 



V V 



CONFIRM SETTI NG BY NCP'~^ SS87 



PPP CONNECTION 
ESTABLISHED 



, - TCR CONNECTION 
ESTABLISHED- 



y 



S588 



S589 



( END ) 



39 



EP 0 99* 260 A2 



FIG. 12 

( START ) 



REQUIRE CONNECTION FOR 
SERVER TO SEND E-MAIL 



S591 




USE START DECLARATION 




S595 



INFORM OF FROM 
INFORMATION 




-S597 



INFORM OF TO 
INFORMATION 




r 



S599 



INFO RM OF TEXT START [ 




S602 



40 



FIG. 13 

( START ) 



REQUIRE CONNECTION FOR \X SS] 1 
SERVER TO RCEIVE E-MAIL 



-S613 : 




REQUIRE INFORMATION 
QFiPLUtfAL IYPE FOR 
SERVER 



X 



S615 



. REQUIRE. NECESSARY 
MAI FOR SERVER 



S619 




41 



A EPG991 260 A2 



cd s 

CO 



>- 

DC 
O 



CO 

CD V 



CM 
CD 
CO 













ZD 




GE 




< 




H- O 


<C | — 


CD CO 



LU CJ> 
CD —J 
LU <C 

ceo 



CO 



CO 

CD> 

CO 



o 



O: 
o: 



cd 

2cc<o: 



CD 
CD 
CO 



CD 

!4J ^ 

IP 



CD 
CO 



CD 

CO 
CO 
LU 

^oz 



LU 



CD 
CO 



CO 

"OL. 
CO 



O 



O 
O 



CO 



CD 

^ LU 
I ^ CO 

xccO; 
CL.CDS: 



o 

CO 



42 

BNSDOCID: <EP 0991260A2J_> 



•ER 0 991/260 A2 



FIG. 15 



( START ) 




A=MEMORY REMAINING;" pr S633 
AMOUNT-RECEIVED AMOUNT 



S634 

A- [TYPICAL 
SIZE OF PRESENT^ 
PHOTOGRAPHING! MODE]> 
PREDETERMINED 
SIZE ? 

JTTno; 



YES 



DECIDE TRANSFER 
DESTINATION 1 



-S635 



TRANSFER REQUIREMENT 
SENDING/DISCONNECTING 



S636 



S637 



PHOTOGRAPH/COMPRESS/ 
RECORD - - 

I 



S638 



RECEIVE/PHOTOGRAPH/ 
COMPRESS/RECORD 



( END ) 



BNSDOCID: <EP_0991260A2_I_> 



43 



f BP. 0 991 260 A2 



( START ) 




IN PHOTOGRAPHING ? 
YES 



A=MEMORY REMAINING 
AMOUNT- RECEIVED AMOUNT 



S633 



S634 

A-[TYPICAL/ 
SIZE OP PRESENT 
PHOTOGRAPHING MODE]> 
PREDETERMINED 
SIZE ? 



YES 



NO 



DECIDE TRANSFER 
DESTINATION 



T 



S635 



RECEIVE ONLY PART, 
TRANSFER REQUIREMENT 
SENDING/DISCONNECTING 



S641 



S637 



PHOTOGRAPH/COMPRESS/ 
RECORD 

I 



S638 



RECEIVE/PHOTOGRAPH/ 
COMPRESS/RECORD 



( END ) 



44 

BNSDOCID: <EP 0991260A2_I_> 



EP 0 99f 260 A2 




A= MEMORY REMAINING 
AMOUNT-RECEIVED AMOUNT 



1^3633 



,, f]^\j \ — 'I'M* ^ 




S638 



RECEIVE/ 
, PHOTOGRAPH/ 
^COMPRESS/RECORD 



DECIDE TRANSFER 
DESTINATION 



-PHOTOGRAPHING- 
STOP/RECEIVE 



TRANSFER REQUIREMENT 
SENDING/DISCONNECTING - 



I 



: i .7 

S636 



PHOTOGRAPH7C0MPRESS/ -TS637 
-RECORD'--' ^ ; '- T ' j r 



C END ) 



45 



HP 0 991 230 A2 



( START 



FIG. 18 



S631 



YES 




S633 



YES 



DECIDE TRANSFER 
DESTINATION 



S635? 



TRANSFER REQUIREMENT 
SENDING/DISCONNECTING 



S 



S636 



S637 



PHOTOGRAPH/COMPRESS/ 
RECORD 

' 1 



S638 



RECEIVE/PHOTOGRAPH/ 
COMPRESS/RECORD 



( END D 



46 



EP 0 99^260 A2 




CD 



CM 
CD 
CO 





1— 












UJ 

o 










<H 


Q CO 



ZD: 

o 



1 1 1 

UJ o 

LU <C 
CC CJ> 



CO^ 



CD 
CD 

co v 



-a: 



O: 
o: 




co 

CO 
LU 

LU£ 




:C0~ 

CD ; 
CO/ 



CL. ^ CJ> 



cq 



I 

o 

I — 

o 



CO 

Q_ LU 
<CQ| 

ocO; 
OS: 



CD 
CO 



BNSDOCID: <EP 0991260A2J_> 



47 



* EP 0 991 260 A2 



FIG. 20 



( START ) 



S6310 




NO - 



A=MEMORY REMAINING i " 
AMOUNT- RECEIVED AMOUNT 



"J. 



=36330 : 




YES 



^SjB350 



S6360 



S6380 



RECEIVE/PHOTOGRAPH/ 
COMPRESS/RECORD 



S6370 



( END ) 



48 



F;P 0 991 260 A2 



FIG. 21 

/^SENDING IMAGE SELECTION 
V SUB-ROUTINE 




BNSDOCID: <EP__0991260A2J_: 



49 



A EP0 991 260 A2 



FIG. 22 



SENDING IMAGE SELECTION 
SUB-ROUTINE 



3 



S6410 



-<rS6420. . 




( RETURN 3 



r S6450 



50 

BNSDOCID: <EP 0991260A2_I_> 



A EP 0 991 260 A2 



FIG. 23 



( START ) 



S6310 

RECEPTION -^-^ NO 
CALLED ? 




( END ) 



51 



" \ lip 0 991 2>€0 A2 



FIG. 24 



C START ) 



S6310 



-S6330 




YES 



COMMUNICATION 
IS FROM SPECIFIC 
PARTNER ? 

S6350 

YES i L ' 



NO 



S6380 



RECEIVE/ 

PHOTOGRAPH/ 

COMPRESS/RECORD 



SELECT SENDING IMAGE 



S6420 



RECEIVING STOP 
PHOTOGRAPH/ 
COMPRESS/RECOR D 



SEND SELECTED IMAGE S 



S6360 



ERASE SELECTED IMAGE 



/S6370 



( END ) 



BNSDOCID: <EP 0991260A2_I_> 



52 



BP Q 991 2S0 A2 



FIG. 25 



( START ) 



S6310 




SELECT SEEDING, .IMAGE 



SEND SELECTED IMAGE 



ERASE SELECTED IMAGE 



RECEIVE/PHOTOGRAPH/ 
COMPRESS/RECORD 



^S6370 



( END ) . 



BNgDOCID: <EP_099126QA2_I_> 



53 




I. ' ' ' 



(19) 



3 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(H) EP 0 991 260 A3 

EUROPEAN PATENT APPLICATION 



(88) 


Date of publication A3: 


(51) intciJ: H04N 1/00, H04N 1/21 




10.07.2002 Bulletin 2002/28 






(43) 


Date of publication A2: 








05.04.2000 Bulletin 2000/14 






(21) 


Application number: 99307742.9 






(22) 


Date of filing: 30.09.1999 






(84) 


Designated Contracting States: 


(72) 


Inventor: Yoshida, Shigeo, 




AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 




c/o Canon Kabushiki Kaisha 




MC NL PT SE 




Tokyo (JP) 




Designated Extension States: 








AL LT LV MK RO SI 


(74) 


Representative: 








Beresford, Keith Denis Lewis et a I 


(30) 


Priority: 30.09.1998 JP 27863098 




BERESFORD & Co. 




30.09.1998 JP 27863198 




2-5 Warwick Court, 








High Holborn 


(71) 


Applicant: CANON KABUSHIKI KAISHA 




London WC1 R SDH (GB) 




Tokyo (JP) 







CO 

< 

o 

CD 
CM 

G> 

o> 
o 

Q. 

LU 



(54) Information processing apparatus, method for the same, and storage medium 



(57) An apparatus for processing information is pro- 
vided which is capable of providing a digital camera hav- 
ing a communication function intended to improve the 
performance while retaining compactness and immedi- 
acy. 

According to one preferred embodiment of the 
present invention, such an apparatus is disclosed that 
to a size of data (first data) expected to be received is 
added an expected size of second data to be entered 
(for example, an expected size of image data obtained 
in a predetermined photography image-quality mode), 
so that a resultant sum is compared to an amount of a 
remaining storage capacity of a memory (storage medi- 
um), and if that sum is largerthan that remaining storage 
capacity, the apparatus sends a direction to an effect 
that the data expecled to be received should be sent 
(transferred) to a predetermined transmission destina- 
tion. With this : in such a case, the first data is not re- 
ceived, so that the first data is sent to the predetermined 
transmission destination. 
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